-- Logs begin at Sat 2022-07-23 20:01:17 UTC, end at Sat 2022-07-23 21:16:21 UTC. -- Jul 23 20:48:23.947728 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 23 20:48:23.956328 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 23 20:48:23.958967 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 23 20:48:23 2022] *** Jul 23 20:48:23.959101 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 23 20:48:23.959205 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 23 20:48:23.959316 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: nodename: dv-osbrick-master-4-ceph Jul 23 20:48:23.959416 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: machine: x86_64 Jul 23 20:48:23.959516 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: clock source: unix Jul 23 20:48:23.959607 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: pcre jit disabled Jul 23 20:48:23.959704 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: detected number of CPU cores: 4 Jul 23 20:48:23.959801 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: current working directory: / Jul 23 20:48:23.959898 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: detected binary path: /usr/bin/uwsgi-core Jul 23 20:48:23.959999 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: your processes number limit is 47680 Jul 23 20:48:23.960089 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: your memory page size is 4096 bytes Jul 23 20:48:23.960189 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: detected max file descriptor number: 2048 Jul 23 20:48:23.960298 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: lock engine: pthread robust mutexes Jul 23 20:48:23.960557 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: thunder lock: enabled Jul 23 20:48:23.961105 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 23 20:48:23.961270 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 23 20:48:24.008413 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: Python main interpreter initialized at 0x5639412fb9c0 Jul 23 20:48:24.008413 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: python threads support enabled Jul 23 20:48:24.008413 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: your server socket listen backlog is limited to 100 connections Jul 23 20:48:24.008413 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: your mercy for graceful operations on workers is 90 seconds Jul 23 20:48:24.008891 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: mapped 403077 bytes (393 KB) for 2 cores Jul 23 20:48:24.008891 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: *** Operational MODE: preforking *** Jul 23 20:48:24.009140 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: *** uWSGI is running in multiple interpreter mode *** Jul 23 20:48:24.009140 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: spawned uWSGI master process (pid: 93836) Jul 23 20:48:24.009372 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 23 20:48:24.012665 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: spawned uWSGI worker 1 (pid: 93848, cores: 1) Jul 23 20:48:24.012665 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: spawned uWSGI worker 2 (pid: 93849, cores: 1) Jul 23 20:48:24.012665 dv-osbrick-master-4-ceph devstack@keystone.service[93836]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 23 20:48:29.725026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:48:29.725026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: from cryptography.utils import int_from_bytes Jul 23 20:48:29.725873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:48:29.725873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: from cryptography.utils import int_from_bytes Jul 23 20:48:29.726269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:48:29.726269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: from cryptography.utils import int_from_bytes Jul 23 20:48:29.726791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:48:29.726791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: from cryptography.utils import int_from_bytes Jul 23 20:48:29.773856 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 20:48:29.774058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 20:48:29.774210 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] command line args: [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 20:48:29.774466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 20:48:29.774682 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ================================================================================ {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 20:48:29.774898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] admin_token = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.775141 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] config_dir = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.775299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.775502 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] config_source = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.775628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 20:48:29.775723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] debug = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.775793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 20:48:29.775857 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.776183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] command line args: [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 20:48:29.776183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 20:48:29.776310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.776369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ================================================================================ {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 20:48:29.777350 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] admin_token = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777585 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] config_dir = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] config_source = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] debug = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.777943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_config_append = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_dir = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_file = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778381 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778435 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778554 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778617 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_config_append = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.778997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_dir = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_file = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.779885 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780260 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780518 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.780959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781053 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781444 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781754 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.781915 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782013 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] publish_errors = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782372 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.782877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] standard_threads = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783487 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] publish_errors = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.783981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] use_journal = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784281 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] use_json = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784387 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] use_stderr = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] use_syslog = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.784873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] standard_threads = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.785047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.785125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.785281 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.785370 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.785485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.785576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.785673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] use_journal = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.785761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.785834 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] use_json = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.785992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.786083 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] use_stderr = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.786155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] use_syslog = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.786224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.786381 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:48:29.786467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.786638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.786728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.786877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.786954 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787128 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787217 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787672 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.787928 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788665 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.788894 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789306 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.789851 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.790015 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.790099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.790629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.790713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.790866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.790943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791111 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791195 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791416 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.791910 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792773 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.792851 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793005 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793480 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.793962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794088 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794193 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794280 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794731 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.794954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795105 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795181 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795411 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795546 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.795861 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.796169 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.796389 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.796739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.796843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797012 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797442 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797587 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797673 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.797939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.798084 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.798162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799709 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.799930 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800069 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800534 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.800950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801268 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801341 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801419 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801491 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.801997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802239 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802483 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802713 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.802947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803094 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803428 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803704 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.803900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804045 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804130 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804278 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804511 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.804852 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805234 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805319 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805569 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805885 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.805979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806056 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806219 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806344 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806496 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806801 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806881 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.806964 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807125 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807421 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807500 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.807918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808010 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808183 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808459 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.808949 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809426 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809558 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809735 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.809894 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810018 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810111 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.external = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810347 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810472 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.810938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811094 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.password = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] auth.token = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811592 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.811945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812039 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812115 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812332 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812489 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.external = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812743 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812827 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.812979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813071 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.password = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813695 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] auth.token = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.813938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814493 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.814979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815369 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815688 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.815836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816010 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816192 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.816939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817072 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817151 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.817873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818496 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818576 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.818981 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819233 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819312 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.819946 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820192 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820812 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.820921 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821004 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821695 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821861 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.821949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822189 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822567 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.822875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823039 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823117 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823273 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823522 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823600 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.823993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824256 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824489 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824749 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.824980 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825059 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825289 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.825982 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826302 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826598 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.826922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827872 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.827988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828098 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828426 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828679 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828821 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.828900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829135 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829292 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829760 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.829840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830090 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830563 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830786 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.830940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831018 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831642 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831874 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.831955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832587 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832688 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.832917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833320 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833642 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.833871 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834328 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.834941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835019 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835276 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835426 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835506 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835755 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.835914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836002 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836149 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836227 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836660 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.836947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837332 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.837879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838043 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838131 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.838994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839302 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839453 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839812 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.839997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840880 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.840971 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841366 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841444 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841601 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841688 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841835 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.841912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842302 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842624 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842789 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.842867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843121 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843271 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] role.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843350 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843523 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] role.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.843998 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844247 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844332 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.844992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845111 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845234 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845471 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845550 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] role.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.845941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] role.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846423 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846754 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846911 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.846990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847585 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847833 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.847913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848167 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848405 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848571 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.848918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849401 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849559 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849752 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.849993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850309 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850478 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850726 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.850968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851045 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851282 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851892 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.851972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852127 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852205 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852452 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852741 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.852954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853123 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853438 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853598 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.853920 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854377 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854534 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854621 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.854842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855337 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.855960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856206 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.connection = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856457 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.856968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857205 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857671 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857758 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.857985 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858382 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858748 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.connection = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.858910 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859471 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.859944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860327 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860406 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.860750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 20:48:29.860826 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.861069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.861317 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.861555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.861805 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.862044 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.862291 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.862526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.862768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.863005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:48:29.863177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 20:48:29.891251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.891537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.891701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.893124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.893359 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.893583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.900523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.902200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.928992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.929189 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.930365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.930579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.981378 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:29.981652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.031897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.032129 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.032861 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.033078 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.098983 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099181 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099254 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099643 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.099813 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.100002 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.100228 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.100450 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.100577 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.124438 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.124693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.124806 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.124950 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.125169 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.125384 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.125584 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.125695 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.125790 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.125891 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.126030 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.126213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.126310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.126449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.139724 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.139939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.152880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153330 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.153963 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.154171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.154275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.154384 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.154485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.154604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.154822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:48:30.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.172937 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:48:30.173223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.173418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:48:30.173684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.173942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.174159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.174246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.174371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:48:30.174466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.174709 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.174909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:48:30.175177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.175437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.175696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.175951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.185391 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.185661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.185930 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.186207 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.187109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.187388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.187659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.187949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.194567 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.196201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.197883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.198158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.198437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.198704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.198976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.199232 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.199495 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.199583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.199809 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.199897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200096 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200382 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200664 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200764 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.200939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.201211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.201605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.202218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.202218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.202449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.227852 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.229206 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.229922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.230208 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.231684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.232117 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.235618 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.235904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.236186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.238866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.239389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.239873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.243564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.243843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.248500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.248984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.249369 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.249639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.249925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.250338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.250762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.251165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.251561 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.251955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.255199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.255629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.255918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.256203 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.256482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.256792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.257070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.257339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.270919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.271213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.275931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.276097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.276544 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.279591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.279878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.281526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.285029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.285216 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.285660 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.288623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.291098 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.292742 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.293041 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.293326 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.293615 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.293886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.294195 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.294718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.298629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.298899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.299185 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.299486 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.299795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.300076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.313410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.313681 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.313982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.314195 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.319230 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.319528 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.319795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.320039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.322285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.324016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.324287 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.327379 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.327654 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.327925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.328196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.328283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.328487 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.329949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.330226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.333338 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.333621 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.333900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.334179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.334465 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.341848 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.342124 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.342400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.342677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.343075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.343347 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.343627 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.348044 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.348331 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.348638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.348916 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.349207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.349481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.349754 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.361885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.365145 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.367949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.368419 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.370034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.371234 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.371644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.371926 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.372205 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.374677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.376293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.377945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.378229 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.378510 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.379764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.381388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.384574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.384882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.385162 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.385438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.385979 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.387601 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.390893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.391177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.391507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.391719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.394526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.394817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.396294 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.400921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.401212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.402709 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.404156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.404435 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.404746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.405017 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.405280 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.405678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.405920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.406223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.406502 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.406741 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.407008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.407271 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.407537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.407787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.410816 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:48:30.411101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.411391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.411662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.411950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.412226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.412501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.412800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.413077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.413344 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.413620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.413891 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.414160 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.414419 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:48:30.451340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639412fb9c0 pid: 93848 (default app) Jul 23 20:48:30.452790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639412fb9c0 pid: 93849 (default app) Jul 23 20:48:30.454892 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e9a54-cd7e-4c40-9d0a-fdcc70c8097f None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:30.455183 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e9a54-cd7e-4c40-9d0a-fdcc70c8097f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:30.455454 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e9a54-cd7e-4c40-9d0a-fdcc70c8097f None None] PATH_INFO: `/v3` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:30.459817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Sat Jul 23 20:48:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:38.586826 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:38.587405 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:38.587405 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:38.591856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:38.597620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:38.598050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:38.598151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:38.672885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: INFO dbcounter [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] Registered counter for database keystone Jul 23 20:48:38.698328 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG oslo_db.sqlalchemy.engines [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 20:48:38.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writer thread running {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 20:48:38.900280 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG passlib.handlers.bcrypt [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93848) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 23 20:48:38.900698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG passlib.handlers.bcrypt [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93848) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 23 20:48:38.956102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:38.957766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:39.088768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 23 20:48:39.284011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:39.360848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: INFO dbcounter [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] Registered counter for database keystone Jul 23 20:48:39.382422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG oslo_db.sqlalchemy.engines [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 20:48:39.390453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writer thread running {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 20:48:39.509422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f8cf-bb68-4cd9-b71b-aef8ade5f62f None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:39.514791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:39.515463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:39.515743 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:39.516022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:39.525129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:39.576418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING keystone.common.rbac_enforcer.enforcer [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 23 20:48:39.576757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342fae-da4d-4efd-8f3b-9eea02757919 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:39.587307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Jul 23 20:48:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 20:48:39.594600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:39.614700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fe3d9-e520-412d-a361-38db2d03df86 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:39.620433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:39.621633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:39.621889 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:39.622167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] PATH_INFO: `/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:39.623796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9e6ecd9bce64bb4817795f5da7ca976)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:39.675997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 23 20:48:39.676355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d044c86-bb70-4b20-b649-7d83f15c24c3 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:39.681095 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Sat Jul 23 20:48:39 2022] GET /identity/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:41.905531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9d61-6795-4f2b-8fff-3245375d9c2c None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:41.906076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9d61-6795-4f2b-8fff-3245375d9c2c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:41.906076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9d61-6795-4f2b-8fff-3245375d9c2c None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:41.912906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:41.923040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:41.923530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:41.923613 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:41.953284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:41.954841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:41.964095 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 23 20:48:41.988245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9d61-6795-4f2b-8fff-3245375d9c2c None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:42.005981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9d61-6795-4f2b-8fff-3245375d9c2c None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:42.014207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4351f9-dec6-4c50-8cc1-bc02f4a3ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:42.015210 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351f9-dec6-4c50-8cc1-bc02f4a3ae8b admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:42.015495 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351f9-dec6-4c50-8cc1-bc02f4a3ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:42.015756 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351f9-dec6-4c50-8cc1-bc02f4a3ae8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:42.024353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4351f9-dec6-4c50-8cc1-bc02f4a3ae8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:42.026204 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4351f9-dec6-4c50-8cc1-bc02f4a3ae8b admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:42.035331 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Jul 23 20:48:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 20:48:42.041558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:42.051412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b713-c18d-4b3d-bc2c-9088f455ad03 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:42.059425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a72b-d534-46d5-8119-db513fe64851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:42.060820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a72b-d534-46d5-8119-db513fe64851 admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:42.061204 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a72b-d534-46d5-8119-db513fe64851 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:42.061566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a72b-d534-46d5-8119-db513fe64851 admin admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:42.064042 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a72b-d534-46d5-8119-db513fe64851 admin admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:42.067641 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a72b-d534-46d5-8119-db513fe64851 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:42.070287 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Jul 23 20:48:42 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:44.384007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f207c2-3ea1-499f-9a90-39bd530d42ae None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.384542 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f207c2-3ea1-499f-9a90-39bd530d42ae None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.384542 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f207c2-3ea1-499f-9a90-39bd530d42ae None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.386015 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:44.387706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fdc69-9f24-44d4-bcc8-0d076893d802 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.388098 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fdc69-9f24-44d4-bcc8-0d076893d802 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.388262 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fdc69-9f24-44d4-bcc8-0d076893d802 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.389723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:48:44.391150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.391435 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.391707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.395279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.395671 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.396092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.415932 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:44.417167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:44.435891 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG passlib.handlers.bcrypt [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93849) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 23 20:48:44.436314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG passlib.handlers.bcrypt [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93849) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 23 20:48:44.481305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:44.482915 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:44.501529 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 7/12] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:44.525307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:44.550562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:44.586326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 6/13] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:44.611192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:44.725590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce7a93-d8b3-49c0-a55d-6ec65ccb4436 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:44.728004 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:44.756704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749514b-d66a-49ed-b333-0d9e8787317c None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:44.770613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:44.772383 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.772797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.773100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.785411 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:48:44.794671 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:44.795328 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.795615 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.795955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:48:44.797105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:48:44.797953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:48:44.798715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:48:44.804319 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:44.868515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:44.870059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:44.892630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:44.905334 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8188dc-f16a-4a5b-a547-e1888c3851e1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:44.939565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:44.940234 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:44.940516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:44.940827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:44.941588 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:44.941896 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:44.943403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:44.955667 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:44.961799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:44.971975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:48:44.977777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:44.989970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:45.074012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731965d6-2e18-402f-b90e-03f59d12ae01 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:45.081390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f581514-674c-4d14-8091-c522e57af609 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:45.107734 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:45.111511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:45.112487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:45.112797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:45.113307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:45.114903 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:45.116378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:45.118067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:48:44 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:45.120167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:45.121016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:45.121300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:45.121578 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:45.123722 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:45.133912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:45.136938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:48:45.157167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:48:45.158046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:48:45.159033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:48:45.159033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:48:45.159033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:48:45.159033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:48:45.159033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:48:45.164242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:45.227699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:45.235158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c3a31-f81f-42a2-b69d-1a2848a95f51 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:45.269218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9717fe-8377-44a6-a7ff-3bb3fa99434a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:45.273831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:45.274643 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:45.274923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:45.275197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:45.276410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:45.277898 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:45.279534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:45.285417 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:45.302735 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:45.303419 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:45.303698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:45.303969 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:45.304743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:45.305047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:45.306497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913dcda-7238-4ca3-a2d1-a0df33e75a0e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:45.326511 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:45.509838 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af8be-043f-4d12-9e9b-68a60fefceef None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:45.549853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:45.550483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:45.550759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:45.551030 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:45.551851 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.domain.id=default, user.id=47b24d52328d4f3cb2e6a6ab9710e538) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:45.552153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:45.553636 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a624-92af-478b-ad22-db960491d3a1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:45.562266 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Jul 23 20:48:45 2022] GET /identity/v3/role_assignments?user.id=47b24d52328d4f3cb2e6a6ab9710e538&scope.domain.id=default&role.id=d384469b72f5485190c772f8974438e0 => generated 233 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:48.160028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c136-d9d8-42ab-97f3-f600c61df906 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.160701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c136-d9d8-42ab-97f3-f600c61df906 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.160701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c136-d9d8-42ab-97f3-f600c61df906 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.162002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:48.180380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c99417-292b-464d-a43d-62f02d5d1722 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.180904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c99417-292b-464d-a43d-62f02d5d1722 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.181004 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c99417-292b-464d-a43d-62f02d5d1722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.205624 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f8c99417-292b-464d-a43d-62f02d5d1722 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:48.207189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f8c99417-292b-464d-a43d-62f02d5d1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:48.232779 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:48.318551 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:48.355405 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c136-d9d8-42ab-97f3-f600c61df906 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:48.395049 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4ff7-288b-462f-86d4-aae74775b2ac None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.395706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4ff7-288b-462f-86d4-aae74775b2ac None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.396191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4ff7-288b-462f-86d4-aae74775b2ac None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.397788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:48:48.403281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785b1b8-3ca7-41fe-839f-df3e509c070b None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.403835 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785b1b8-3ca7-41fe-839f-df3e509c070b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.404296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785b1b8-3ca7-41fe-839f-df3e509c070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.429050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:48.435393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-5785b1b8-3ca7-41fe-839f-df3e509c070b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:48.438715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-5785b1b8-3ca7-41fe-839f-df3e509c070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:48.590081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:48:48.614295 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8db1-3151-4d06-b02b-fe141afcf8a4 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.614575 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8db1-3151-4d06-b02b-fe141afcf8a4 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.615089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8db1-3151-4d06-b02b-fe141afcf8a4 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.615413 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c136-d9d8-42ab-97f3-f600c61df906 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:48.617233 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:48.622340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8db1-3151-4d06-b02b-fe141afcf8a4 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:48.680228 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cbefc-e17f-4fa4-949c-ffec87452a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:48.681168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cbefc-e17f-4fa4-949c-ffec87452a2c None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.682285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cbefc-e17f-4fa4-949c-ffec87452a2c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.683243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cbefc-e17f-4fa4-949c-ffec87452a2c None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.684294 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cbefc-e17f-4fa4-949c-ffec87452a2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:48.686640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cbefc-e17f-4fa4-949c-ffec87452a2c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:48.776512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:48.794263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8db1-3151-4d06-b02b-fe141afcf8a4 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:48.828882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794cb88-6599-47fc-bacf-25db3002fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:48.829918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794cb88-6599-47fc-bacf-25db3002fe22 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.830381 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794cb88-6599-47fc-bacf-25db3002fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.830803 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794cb88-6599-47fc-bacf-25db3002fe22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.842253 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794cb88-6599-47fc-bacf-25db3002fe22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:48:48.849158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 12/27] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jul 23 20:48:48 2022] POST /identity/v3/roles => generated 219 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:48:48.850847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bfca3-a098-4538-94cf-c9a912bd7aa0 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.851244 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bfca3-a098-4538-94cf-c9a912bd7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-7794cb88-6599-47fc-bacf-25db3002fe22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:48:48.851423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:48:48.852367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:48.853153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:48:48.853717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bfca3-a098-4538-94cf-c9a912bd7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.856013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 16/28] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:48:48.857962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86665-ae3d-4268-a102-942b96280538 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:48.859550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86665-ae3d-4268-a102-942b96280538 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:48.860163 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86665-ae3d-4268-a102-942b96280538 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:48.862155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 17/29] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:48.863398 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b86665-ae3d-4268-a102-942b96280538 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:48.899081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-a84bfca3-a098-4538-94cf-c9a912bd7aa0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:48.901371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-a84bfca3-a098-4538-94cf-c9a912bd7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:49.035778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 13/30] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:49.035778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.035778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.035778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.055600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:49.056885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:49.079626 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b86665-ae3d-4268-a102-942b96280538 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.087504 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.125672 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.126411 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.126696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.127048 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.127811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:49.128122 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.129619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb1834-2031-4af6-9859-a0d633b71169 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.140000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 18/31] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:49.143279 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6502e8-a390-4a3c-8dc5-3e14996216b1 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.143279 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6502e8-a390-4a3c-8dc5-3e14996216b1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.143603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6502e8-a390-4a3c-8dc5-3e14996216b1 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.145098 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 19/32] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:49.145815 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6502e8-a390-4a3c-8dc5-3e14996216b1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.156911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.164579 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 14/33] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:49.165911 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.275558 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6502e8-a390-4a3c-8dc5-3e14996216b1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.284054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0750295-dbef-444b-9639-7ccb26d2d2c9 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.312575 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.313378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.313656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.313927 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.319582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec253450-0700-4c60-b350-1e5f4cf21827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.320476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec253450-0700-4c60-b350-1e5f4cf21827 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.320797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec253450-0700-4c60-b350-1e5f4cf21827 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.321078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec253450-0700-4c60-b350-1e5f4cf21827 None admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.322350 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec253450-0700-4c60-b350-1e5f4cf21827 None admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.323953 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec253450-0700-4c60-b350-1e5f4cf21827 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.325650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 15/34] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:48:49 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:49.326802 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.327277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.327518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.339374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.340965 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.345564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:49.346758 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:48:49.360875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:48:49.361742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:48:49.362525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:48:49.362525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:48:49.362525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:48:49.362525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:48:49.362525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 20/35] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:48:49.363237 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.369635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.436627 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 16/36] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:49.436627 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.437927 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.473586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e8b89-5b34-4824-a58f-5bc9f93770d2 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.508251 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.508961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.509235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.509501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.510251 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.511639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.538201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909035f3-d7de-4bbd-a6d0-d892b965d944 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.574732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.575467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.575752 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.576030 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.577312 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.578783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.585439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 17/37] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:49.585439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.608464 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.642020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 21/38] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jul 23 20:48:49 2022] POST /identity/v3/roles => generated 225 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:48:49.643025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.720088 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9d94-3c61-4881-ab8e-361c2bc7ef66 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.771974 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed230-49bf-4d12-b046-247674b90488 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.778287 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.779307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.779825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.780355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.782013 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:49.782544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.784798 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.796818 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.807194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 18/39] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:49.807194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.819313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178bd21-03c6-4f80-aba1-6ef4a05a54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:49.820150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178bd21-03c6-4f80-aba1-6ef4a05a54eb None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.820507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178bd21-03c6-4f80-aba1-6ef4a05a54eb None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.820826 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178bd21-03c6-4f80-aba1-6ef4a05a54eb None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.821612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178bd21-03c6-4f80-aba1-6ef4a05a54eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:49.823171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178bd21-03c6-4f80-aba1-6ef4a05a54eb None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:49.841085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 22/40] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jul 23 20:48:49 2022] POST /identity/v3/roles => generated 223 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:48:49.842639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a042f-34cf-4fa3-a9b4-b48518b74d58 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:49.843013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a042f-34cf-4fa3-a9b4-b48518b74d58 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:49.843394 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a042f-34cf-4fa3-a9b4-b48518b74d58 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:49.845644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 23/41] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:49.845775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a042f-34cf-4fa3-a9b4-b48518b74d58 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:49.935970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:49.964243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c4baa-5de0-4b59-9ec9-e23bb3f6a87a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:49.996829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a042f-34cf-4fa3-a9b4-b48518b74d58 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:50.007141 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048399a-91f5-4cfc-bab5-722f8dea8d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:50.008384 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048399a-91f5-4cfc-bab5-722f8dea8d70 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:50.008716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048399a-91f5-4cfc-bab5-722f8dea8d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:50.009196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048399a-91f5-4cfc-bab5-722f8dea8d70 None admin] PATH_INFO: `/v3/domains/default/users/47b24d52328d4f3cb2e6a6ab9710e538/roles/d384469b72f5485190c772f8974438e0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:50.011307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048399a-91f5-4cfc-bab5-722f8dea8d70 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=47b24d52328d4f3cb2e6a6ab9710e538, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:50.012863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048399a-91f5-4cfc-bab5-722f8dea8d70 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:50.029220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 19/42] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Jul 23 20:48:49 2022] PUT /identity/v3/domains/default/users/47b24d52328d4f3cb2e6a6ab9710e538/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:48:50.030277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:50.030565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:50.030841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:50.043190 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:50.043899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:50.044184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:50.044459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:50.045240 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:50.046837 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:50.057106 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:50.060194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:50.091396 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 24/43] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:48:49 2022] POST /identity/v3/projects => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:48:50.170952 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 20/44] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:50.198260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:50.238335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:50.342089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8e3fd-37f3-4d91-9e39-e5529be432d9 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:50.377644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd995032-1cb0-4c8e-9641-684b9dab6822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:50.378468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995032-1cb0-4c8e-9641-684b9dab6822 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:50.378750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995032-1cb0-4c8e-9641-684b9dab6822 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:50.379022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995032-1cb0-4c8e-9641-684b9dab6822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:50.380208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd995032-1cb0-4c8e-9641-684b9dab6822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:50.381722 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd995032-1cb0-4c8e-9641-684b9dab6822 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:50.383372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 25/45] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:50.389399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:50.460490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:50.494161 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89741ff8-3ebd-4418-bc36-68ea35680fc4 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:50.530185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91748f-f8c2-45de-8879-a6c094dd46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:50.530898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91748f-f8c2-45de-8879-a6c094dd46ba None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:50.531184 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91748f-f8c2-45de-8879-a6c094dd46ba None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:50.531471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91748f-f8c2-45de-8879-a6c094dd46ba None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:50.532190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91748f-f8c2-45de-8879-a6c094dd46ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:50.533711 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91748f-f8c2-45de-8879-a6c094dd46ba None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:50.562435 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 21/46] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:48:50 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:48:52.328655 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ae79b-fd5c-470f-900f-fdfeca4b7cc9 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.329201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ae79b-fd5c-470f-900f-fdfeca4b7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.329201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ae79b-fd5c-470f-900f-fdfeca4b7cc9 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.330593 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 26/47] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:52.335988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.336416 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.336636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.354030 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:52.355223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:52.424623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 22/48] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:52.448971 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ae79b-fd5c-470f-900f-fdfeca4b7cc9 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:52.556719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:52.561185 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ae79b-fd5c-470f-900f-fdfeca4b7cc9 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:52.596925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:52.597725 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.598010 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.598287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.608722 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:48:52.616287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:48:52.617194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:48:52.617931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 27/49] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:48:52.623553 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:52.680762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:52.727993 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea6cf-b7bb-41ca-a16e-9be4a3602696 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:52.760831 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:52.761506 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.761793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.762070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.762820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:52.763121 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:52.764565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec00e69-b859-44c6-9b13-5af470d20125 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:52.776191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 23/50] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:52.782105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:52.809541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0243d-e951-4c05-8295-d2a083f439ac None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.809751 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0243d-e951-4c05-8295-d2a083f439ac None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.810030 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0243d-e951-4c05-8295-d2a083f439ac None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.812054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 24/51] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:52.817048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.817331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.817619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.835102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:52.836315 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:52.896646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4ca6-c9aa-4cce-965e-bd4b2957b928 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:52.912791 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 25/52] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:52.934077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:52.934969 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:52.935253 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:52.935528 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:52.936982 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:52.937288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:52.938454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:52.940127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 28/53] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:48:52 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:52.946805 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:52.978749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:52.981964 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:53.035457 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fa09d-323a-4da9-ac58-9e7d96a8e86d None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:53.050158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46a1ed-f2da-4b42-afce-e4dc33359732 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:53.069400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:53.070142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:53.070428 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:53.070707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:53.071912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:53.073443 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:53.075077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 26/54] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:53.081106 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:53.083192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:53.084005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:53.084287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:53.084564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:53.085784 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:53.087227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:53.088882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:53.094680 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:53.191055 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c942c-4289-46b3-a933-60faea99e4c2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:53.192925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:53.199320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ca324-7364-46ad-b683-7dbf3fe0bd02 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:53.204299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:53.226090 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7841fe-03bb-43ae-b232-73582a72b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:53.226757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7841fe-03bb-43ae-b232-73582a72b728 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:53.227042 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7841fe-03bb-43ae-b232-73582a72b728 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:53.227323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7841fe-03bb-43ae-b232-73582a72b728 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:53.228043 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7841fe-03bb-43ae-b232-73582a72b728 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:53.229530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7841fe-03bb-43ae-b232-73582a72b728 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:53.232978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:53.233676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:53.233955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:53.234229 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:53.235045 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.domain.id=default, user.id=47b24d52328d4f3cb2e6a6ab9710e538) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:48:53.235369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:53.236820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcb694-cde8-4ce8-a788-d6f963e3d0e7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:53.243006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 30/56] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Jul 23 20:48:53 2022] GET /identity/v3/role_assignments?user.id=47b24d52328d4f3cb2e6a6ab9710e538&scope.domain.id=default&role.id=d384469b72f5485190c772f8974438e0 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:48:53.259284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 27/57] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Jul 23 20:48:53 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:48:55.504521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a35c1-5002-46a3-bb4d-77dfedcc12bd None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:55.505378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a35c1-5002-46a3-bb4d-77dfedcc12bd None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:55.505378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a35c1-5002-46a3-bb4d-77dfedcc12bd None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:55.507572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:55.514004 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:55.514790 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:55.514875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:55.534511 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:55.535930 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:55.621456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:55.647991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a35c1-5002-46a3-bb4d-77dfedcc12bd None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:55.749640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a35c1-5002-46a3-bb4d-77dfedcc12bd None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:55.783385 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd59da-cdca-47e5-90bf-eb117a9b9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:55.784170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd59da-cdca-47e5-90bf-eb117a9b9580 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:55.784448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd59da-cdca-47e5-90bf-eb117a9b9580 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:55.784749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd59da-cdca-47e5-90bf-eb117a9b9580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:55.786042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd59da-cdca-47e5-90bf-eb117a9b9580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:55.787490 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd59da-cdca-47e5-90bf-eb117a9b9580 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:55.789141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 32/60] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:48:55.795918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:55.891931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:55.905023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688c40-5d77-45ed-89dc-1c1109be2753 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:55.948925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a95f93-dd53-4076-bd1f-54bb778cab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:55.949602 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a95f93-dd53-4076-bd1f-54bb778cab68 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:55.949884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a95f93-dd53-4076-bd1f-54bb778cab68 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:55.950168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a95f93-dd53-4076-bd1f-54bb778cab68 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:55.950885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a95f93-dd53-4076-bd1f-54bb778cab68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:48:55.952411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a95f93-dd53-4076-bd1f-54bb778cab68 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:48:55.981119 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 29/61] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:48:55 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:48:59.515269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59d6b-f27e-47df-92af-f09d8d377893 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.515774 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59d6b-f27e-47df-92af-f09d8d377893 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.515774 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59d6b-f27e-47df-92af-f09d8d377893 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.517206 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:59.532584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531ff2-2150-436b-b1e6-75853207e792 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.533135 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531ff2-2150-436b-b1e6-75853207e792 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.533135 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531ff2-2150-436b-b1e6-75853207e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.557667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-87531ff2-2150-436b-b1e6-75853207e792 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:59.558898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-87531ff2-2150-436b-b1e6-75853207e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:59.653997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 30/63] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:59.662848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fc90b-f9e2-4ccc-99df-525493413362 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.663397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fc90b-f9e2-4ccc-99df-525493413362 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.663868 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fc90b-f9e2-4ccc-99df-525493413362 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.665870 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 34/64] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:59.670972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e28a4-1340-43f8-930f-377738642788 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.671266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e28a4-1340-43f8-930f-377738642788 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.671548 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e28a4-1340-43f8-930f-377738642788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.684361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fc90b-f9e2-4ccc-99df-525493413362 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:59.697717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-873e28a4-1340-43f8-930f-377738642788 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:59.704712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-873e28a4-1340-43f8-930f-377738642788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:59.729013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:59.788576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 31/65] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:59.790665 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64590895-9289-4d39-8b56-3cfdb70c5122 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.791263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64590895-9289-4d39-8b56-3cfdb70c5122 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.791388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64590895-9289-4d39-8b56-3cfdb70c5122 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.797537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 32/66] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:59.797537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0916a-c7ce-416f-9327-01331972e468 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.797537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0916a-c7ce-416f-9327-01331972e468 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.797537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0916a-c7ce-416f-9327-01331972e468 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.797537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:48:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:48:59.798444 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.798736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.799019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.820931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:59.822137 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:59.826055 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:48:59.831899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fc90b-f9e2-4ccc-99df-525493413362 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:48:59.867294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1d43-3f8c-4b24-83f9-cb489b4260cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:48:59.868089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1d43-3f8c-4b24-83f9-cb489b4260cb None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.868349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1d43-3f8c-4b24-83f9-cb489b4260cb None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.868652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1d43-3f8c-4b24-83f9-cb489b4260cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.879854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1d43-3f8c-4b24-83f9-cb489b4260cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-3d2f1d43-3f8c-4b24-83f9-cb489b4260cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:48:59.887497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:48:59.888524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:48:59.889369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:48:59.890370 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:48:59.890651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:48:59.890979 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:48:59.900385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:48:59.901137 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:48:59.915677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:48:59.918130 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:48:59.989225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 36/70] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:48:59.990123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.011491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.024968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b24fe-71da-4e46-9b2f-308200eb1959 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.065585 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.066313 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.066595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.066870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.076005 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.079473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:00.088841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:00.089712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:00.090498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:48:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:00.091121 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.103241 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9426f-0327-4c53-b5fd-dee11098c3a4 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.138846 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.139568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.139853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.140133 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.141018 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:00.141323 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.142724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.155883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.155883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.203910 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e8969-93a1-48a9-8a74-4ffcd20c01f2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.235061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.237283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.238262 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.238570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.238835 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.249830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:00.257551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:00.258557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:00.259503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:00.260283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.263200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545be55-527e-4cd7-8f8d-85c4084d551c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.298296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.299116 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.299402 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.299678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.310166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:00.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:00.319699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:00.320521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:00.321192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.328025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.373225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d23c-42b4-4ef3-807a-0c3ba870ac1f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.421464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9678c9-b036-437e-a50c-bde03f6301dd None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.425368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.426033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.426313 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.426580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.427322 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:00.427620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.429060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f37b80-0001-4f8f-be63-07eac152a720 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.437280 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.438494 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1dd8c-c65d-433a-8bf0-07e41b5c6d43 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.438778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1dd8c-c65d-433a-8bf0-07e41b5c6d43 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.439080 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1dd8c-c65d-433a-8bf0-07e41b5c6d43 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.440439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 38/76] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:00.441074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1dd8c-c65d-433a-8bf0-07e41b5c6d43 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.459172 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.460068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.460340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.460640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.461862 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.463333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.465021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.469783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.480713 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.542310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1dd8c-c65d-433a-8bf0-07e41b5c6d43 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.564966 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.571586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b52e-11a6-4281-b939-938aa9ac8126 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.577024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.577689 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.577968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.578239 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.578985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:00.579281 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.580694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.589675 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.590477 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.604984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.605657 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.605940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.606205 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.606948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:00.607250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.608775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cb259-4cc9-4fa1-b52b-222504ee8be2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.616705 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.617896 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.618209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.618488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.634692 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:00.635913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:00.697179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.699876 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da752ad-339a-4a31-ae93-7bf102ecea2b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.703009 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 41/80] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:00.703941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.743581 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.744472 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.744794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.745068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.762155 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.763633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.766249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 40/81] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.767018 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.812415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b67f1-4272-4292-9c41-002ae97e9ec3 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.816008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.847520 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.848097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.848422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.848718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.873677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22ad8-15fb-4a93-b56e-313993878246 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:00.907864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e49c88-061b-4172-8325-08310b767420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:00.908776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e49c88-061b-4172-8325-08310b767420 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:00.909041 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e49c88-061b-4172-8325-08310b767420 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:00.909314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e49c88-061b-4172-8325-08310b767420 None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:00.910498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e49c88-061b-4172-8325-08310b767420 None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.911967 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e49c88-061b-4172-8325-08310b767420 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:00.912586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:00.913703 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:00.914411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e49c88-061b-4172-8325-08310b767420 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:00.915889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:00.917911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.016151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e49c88-061b-4172-8325-08310b767420 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.018861 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 42/83] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:01.019473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.028432 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.054026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.065210 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.065535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.065810 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.067153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.068674 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.070357 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:00 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:01.075377 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.123284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.126623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03da1-b869-4022-b2e0-bd233fb829c2 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.162906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.163716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.163998 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.164275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.165853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.167324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.169005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 43/85] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:01.169806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.178480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304eda0-80e6-42dc-b640-2c96971d026d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.214250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.214896 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.215171 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.215449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.266139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.271344 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9808-2d6a-4b20-b10f-2f441a5346bc None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.288434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.290356 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.307137 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.307799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.308080 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.308357 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.342820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.377942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.379333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.389823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:01.390676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.464905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.482437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 44/87] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:01.483445 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.487934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075659b-dd7d-4938-a4c9-1cd8a1affc5f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.522019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.522897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.523181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.523460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.524720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.526190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.527956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:01.528816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.551943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.584845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6cc2-ec45-4a77-b416-b3bacd78df40 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.618146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.618804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.619073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.619367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.625577 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55430a46-50cb-402a-8d4b-1eb4288a9604 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.659811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.660482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.660761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.661029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.661854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.663218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.683652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 45/89] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:01 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:01.684793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.689857 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.691550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.698136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.767742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.805499 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9a836-e594-4917-a98a-4e469aa6033b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.807027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:01.812930 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.847302 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.848596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.849254 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.849711 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.852005 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.853762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.856234 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:01.857218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:01.926670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178262c8-d52b-4374-b839-92ea0b952766 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.935407 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:01.976079 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:01.977188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:01.977745 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:01.978028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] PATH_INFO: `/v3/projects/9b51a69660234f48a33ef4579a1470a1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:01.979378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] RBAC: Authorizing `identity:get_project(project_id=9b51a69660234f48a33ef4579a1470a1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:01.979488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17421c-e0a5-465e-ace5-27f7c331fc18 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:01.981166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:01.984156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/projects/9b51a69660234f48a33ef4579a1470a1 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:01.985125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:02.025258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:02.033582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:02.034028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:02.034318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:02.034599 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:02.035757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=47b24d52328d4f3cb2e6a6ab9710e538) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:02.036236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:02.038049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:02.050156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/role_assignments?user.id=47b24d52328d4f3cb2e6a6ab9710e538&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=d384469b72f5485190c772f8974438e0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:02.050901 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:02.137677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d758e-3c3f-4a91-a46d-8619fb3a2d0a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:02.210115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5c559-3c8f-4607-b837-b6808a773280 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:02.219789 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:02.221366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:02.226631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:02.227177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:02.228820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:02.230614 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:02.235335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:01 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:02.238284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:02.288958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:02.289650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:02.290308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:02.290591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:02.291447 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=08fb641a93854b1bbaaade59a09529f4) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:02.291760 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:02.293311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:02.298908 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:02.305991 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:02 2022] GET /identity/v3/role_assignments?user.id=08fb641a93854b1bbaaade59a09529f4&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:02.306843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:02.459365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42fba-2cd3-44e3-86e9-901995f7ca11 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:02.463639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:02.513634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf2103-1928-467e-bef8-3f26ed9ff7f8 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:02.532074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:02.532789 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:02.533075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:02.533356 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:02.534203 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=9b51a69660234f48a33ef4579a1470a1, user.id=08fb641a93854b1bbaaade59a09529f4) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:02.534616 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:02.536176 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a92411-b61a-476c-b7f7-5dd7a32b5008 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:02.551807 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:02 2022] GET /identity/v3/role_assignments?user.id=08fb641a93854b1bbaaade59a09529f4&scope.project.id=9b51a69660234f48a33ef4579a1470a1&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:02.566102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:02.566795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:02.567084 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:02.567417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:02.568275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] RBAC: Adding query filter params (role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=08fb641a93854b1bbaaade59a09529f4) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:02.568589 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:02.570126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ba35-f1c0-4baf-9615-560180037356 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:02.577215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:02 2022] GET /identity/v3/role_assignments?user.id=08fb641a93854b1bbaaade59a09529f4&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=286215d5d755461885cd022a8d6d411a => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:04.622104 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e535-8cee-4479-9252-080f9954db3e None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:04.622662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e535-8cee-4479-9252-080f9954db3e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:04.622662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e535-8cee-4479-9252-080f9954db3e None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:04.624183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:04.630364 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc344-8078-4693-ace2-73e90b11833b None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:04.630863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc344-8078-4693-ace2-73e90b11833b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:04.630957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc344-8078-4693-ace2-73e90b11833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:04.632022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6d917-f35d-4d69-935d-fe124aa898ae None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:04.632436 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6d917-f35d-4d69-935d-fe124aa898ae None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:04.632758 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6d917-f35d-4d69-935d-fe124aa898ae None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:04.634147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 50/99] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:04.639450 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:04.639739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:04.640020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:04.653484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-660dc344-8078-4693-ace2-73e90b11833b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:04.654718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-660dc344-8078-4693-ace2-73e90b11833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:04.657669 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:04.658872 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:04.741577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 51/100] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:04.769961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:04.776636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:04.798868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 50/101] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:04.840440 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dc344-8078-4693-ace2-73e90b11833b None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:04.885871 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:04.890939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a594-18a4-46f6-913b-b25518426de6 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:04.928122 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:04.928975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:04.929260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:04.929541 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:04.930929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:04.932421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:04.934415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 52/102] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:04.939813 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:05.011473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dc344-8078-4693-ace2-73e90b11833b None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:05.046622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8e5db-771c-4a58-9979-b8e49892edc5 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:05.084935 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:05.085611 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.085894 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.086276 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.087112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:05.088686 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:05.097931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:05.098771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.099058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.099340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.122855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 53/103] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:49:04 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:49:05.129877 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:05.138064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:05.140201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:05.142179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 51/104] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:05.145860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:05.172635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:05.292422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905e261-ba86-4471-bcb9-2bc7c27df262 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:05.335720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:05.336463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.336804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.337083 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.337841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:05.338151 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:05.339546 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1844ae3-3ee9-479e-b3e6-a9310d6bb2bf None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:05.352819 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 54/105] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:05.358956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:05.430829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:05.490790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b5bf-a9b0-40d4-8b17-c7ac8c2b931e None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.491204 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b5bf-a9b0-40d4-8b17-c7ac8c2b931e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.491453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b5bf-a9b0-40d4-8b17-c7ac8c2b931e None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.492777 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 55/106] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:49:05.498538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.499071 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.499294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.514553 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65a670-7903-43e4-98af-5415bc9f5be4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:05.527358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:05.528616 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:05.579728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:05.581832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.581832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.581832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] PATH_INFO: `/v3/users/884e0237f04a4351802e396f8bab85db` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.602174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=884e0237f04a4351802e396f8bab85db)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:05.604161 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:05.606329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 52/107] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:05 2022] GET /identity/v3/users/884e0237f04a4351802e396f8bab85db => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:05.613723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:05.710678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 56/108] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:05.730747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b7617-596f-42ac-91ce-521d70c6a0e0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:05.745056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:05.753473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:05.774594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:05.776038 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:05.776775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.777127 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.777299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.868519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:05.870948 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:05.893881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f6984-2216-4046-9cd9-6115e8c0bcf1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:05.945327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f906ae-2730-4e7a-ad5e-ed76309d2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:05.947326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f906ae-2730-4e7a-ad5e-ed76309d2c7f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.947606 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f906ae-2730-4e7a-ad5e-ed76309d2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.947880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f906ae-2730-4e7a-ad5e-ed76309d2c7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.976413 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f906ae-2730-4e7a-ad5e-ed76309d2c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-86f906ae-2730-4e7a-ad5e-ed76309d2c7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:05.984129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:05.985026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:05.985782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 57/109] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:05.986766 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e576-a3e2-4137-9a85-fa1cc8419653 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.986959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e576-a3e2-4137-9a85-fa1cc8419653 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.987265 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e576-a3e2-4137-9a85-fa1cc8419653 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:05.988725 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 58/110] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:05.994017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:05.994294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:05.994573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.011803 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:06.013083 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:06.027827 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 53/111] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:06.030080 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.054508 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.139469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.146059 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 59/112] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:06.146930 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.165957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b1cdc-97a8-4e04-aa55-d5a43987b7a4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.210310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.211077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.211373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.211789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.216484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:06.216484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:06.216484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:06.239684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 54/113] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:06.240649 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.343939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.345080 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc853-1c32-435a-ba1f-88e5312d19bb None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.383823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6abae-056e-4f63-b103-7045801a84a9 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.390466 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.391359 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.391640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.395482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.395482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:06.395482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:06.400754 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 60/114] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:06.401995 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.432645 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a28f3-cc23-4afc-84c7-24343a0fd807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.433528 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a28f3-cc23-4afc-84c7-24343a0fd807 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.433815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a28f3-cc23-4afc-84c7-24343a0fd807 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.434099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a28f3-cc23-4afc-84c7-24343a0fd807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.446074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a28f3-cc23-4afc-84c7-24343a0fd807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-f30a28f3-cc23-4afc-84c7-24343a0fd807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:06.454338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:06.455249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:06.455994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 55/115] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:06.458274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a7a8-f0bb-41f0-b842-e03e3ddc9f55 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.458274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a7a8-f0bb-41f0-b842-e03e3ddc9f55 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.458274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a7a8-f0bb-41f0-b842-e03e3ddc9f55 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.460700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 56/116] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:06.460700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a7a8-f0bb-41f0-b842-e03e3ddc9f55 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.484580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.522495 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0bec7-93cb-4568-9861-bab27ec0edf8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.559121 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e08662-447b-4539-a749-04e0c54d7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.560020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08662-447b-4539-a749-04e0c54d7d7c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.560290 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08662-447b-4539-a749-04e0c54d7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.560797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08662-447b-4539-a749-04e0c54d7d7c None admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.561843 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e08662-447b-4539-a749-04e0c54d7d7c None admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:06.563307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e08662-447b-4539-a749-04e0c54d7d7c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:06.565177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 61/117] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:06.570454 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a7a8-f0bb-41f0-b842-e03e3ddc9f55 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.570882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf298-a8ec-4e2e-b515-bb8c37a825fa None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.571171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf298-a8ec-4e2e-b515-bb8c37a825fa None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.571449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf298-a8ec-4e2e-b515-bb8c37a825fa None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.576983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 62/118] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:06.576983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf298-a8ec-4e2e-b515-bb8c37a825fa None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.604777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.611113 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.612046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.612334 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.612800 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.613945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] RBAC: Adding query filter params (role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=884e0237f04a4351802e396f8bab85db) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:06.614528 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:06.616012 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25813-96c0-4aec-8fe2-97860b5307a1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:06.624788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 57/119] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/role_assignments?user.id=884e0237f04a4351802e396f8bab85db&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:06.626088 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.626355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.626657 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.647064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:06.648342 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:06.723828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf298-a8ec-4e2e-b515-bb8c37a825fa None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.727397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 58/120] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:06.737656 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.771818 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.772654 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.772922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.773211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.774051 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:06.774407 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:06.775817 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb1a1-7b42-40a2-985c-7c0f7a12cf96 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:06.778911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.793267 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:06.795242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.795733 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.796159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.815589 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:06.817223 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:06.874953 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de56f57-51a6-493f-9473-b863281ff740 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:06.900646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 64/122] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:06.909353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:06.909581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:06.922506 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:06.923730 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:06.924154 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:06.924565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:06.926093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:06.928542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:06.931208 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:06.933558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.050847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14140cf4-328e-4ef0-bc01-7cc6cff4e04c None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.065044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9a24-1104-462a-b8e8-aeebebc30bf0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.082289 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:07.091720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.092628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.092937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.093266 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.104480 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:07.110514 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.111586 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.112012 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.112427 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:07.112630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:07.113633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:07.114497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:07.116630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:07.118221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:07.118833 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 65/124] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:07.119661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.120713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 60/125] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:06 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:07.121685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.203635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:07.241350 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6df75-3445-41b6-9f03-0a22d7ef0aa4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.255249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6e3a0-0115-4a6d-a3fc-f8d2015b8c91 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.285330 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.287006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.287686 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.288191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/47b24d52328d4f3cb2e6a6ab9710e538/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.291262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32704e1694041efbe1cdb94f6ff9aa8, user_id=47b24d52328d4f3cb2e6a6ab9710e538, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:07.291725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.292620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.292915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.293194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.293559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:07.305620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:07.312561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 66/126] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:07 2022] PUT /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/47b24d52328d4f3cb2e6a6ab9710e538/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:07.314329 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:07.315373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 61/127] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:07.321390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.323061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.430278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:07.516216 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7a795-a609-4e79-bf3d-720d25ecf1a3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.558316 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.559306 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.559442 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff5c9-0b0d-4a3f-ba69-77cfd498d258 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.559847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.560258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.561499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:07.561944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:07.563505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:07.574715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 67/128] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:07.575949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.611793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:07.634338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.635407 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.635545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.635771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.637929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:07.639567 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:07.641668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 62/129] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:07 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:07.642468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.710209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd81c-e98e-47c3-ba99-8d2b61b6fb0e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.724857 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:07.768320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.769041 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.769329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.769609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.770377 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:07.770689 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:07.772128 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:07.783410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 68/130] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:07.783410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.801269 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14a06-9cc3-4327-a948-a631f7eafa3b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.849505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:07.850335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:07.850622 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:07.850900 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:07.852203 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:07.853728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:07.855707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 63/131] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:07 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:07.856489 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:07.929618 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc690-8f35-4dfc-8790-ca25f8ee9ef4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:07.968202 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:08.004313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.005256 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.005543 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.005824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/08fb641a93854b1bbaaade59a09529f4/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.010633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32704e1694041efbe1cdb94f6ff9aa8, user_id=08fb641a93854b1bbaaade59a09529f4, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.012112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.036824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd647ba-4d1f-4137-84f3-3ec0119982bc None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:08.048324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 69/132] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:07 2022] PUT /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/08fb641a93854b1bbaaade59a09529f4/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:08.049233 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:08.096566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.098071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.098676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.099214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.101027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.102844 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.105437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 64/133] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:07 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:08.111380 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:08.153719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:08.242914 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99967b-b9e0-406f-ac73-63856d83b4f0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:08.282071 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ba78-cd1f-45f3-98a7-fb287a222619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.283127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ba78-cd1f-45f3-98a7-fb287a222619 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.283419 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ba78-cd1f-45f3-98a7-fb287a222619 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.283696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ba78-cd1f-45f3-98a7-fb287a222619 None admin] PATH_INFO: `/v3/projects/9b51a69660234f48a33ef4579a1470a1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.284970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480ba78-cd1f-45f3-98a7-fb287a222619 None admin] RBAC: Authorizing `identity:get_project(project_id=9b51a69660234f48a33ef4579a1470a1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.287490 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480ba78-cd1f-45f3-98a7-fb287a222619 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.291009 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 70/134] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:08 2022] GET /identity/v3/projects/9b51a69660234f48a33ef4579a1470a1 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:08.292270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7ec8b-6c3e-4a0b-8d82-8fca7c690910 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.292558 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7ec8b-6c3e-4a0b-8d82-8fca7c690910 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.294417 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7ec8b-6c3e-4a0b-8d82-8fca7c690910 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.295823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 71/135] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:08.299967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7ec8b-6c3e-4a0b-8d82-8fca7c690910 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:08.342652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7253f-f4ee-49d5-9a28-a0172cb2c378 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:08.384971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:08.403425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3befd-6e65-4d7f-bbe4-29b3cc5d628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.404596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3befd-6e65-4d7f-bbe4-29b3cc5d628f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.405143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3befd-6e65-4d7f-bbe4-29b3cc5d628f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.405563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3befd-6e65-4d7f-bbe4-29b3cc5d628f None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.407620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3befd-6e65-4d7f-bbe4-29b3cc5d628f None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.409924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3befd-6e65-4d7f-bbe4-29b3cc5d628f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.416247 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 65/136] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:08 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:08.418531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.418976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.419429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.441025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:08.442646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:08.469991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:08.482241 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7ec8b-6c3e-4a0b-8d82-8fca7c690910 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:08.524240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 66/137] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:08.529761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:08.542573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.543269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.543666 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.544043 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] PATH_INFO: `/v3/projects/9b51a69660234f48a33ef4579a1470a1/users/08fb641a93854b1bbaaade59a09529f4/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.546182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b51a69660234f48a33ef4579a1470a1, user_id=08fb641a93854b1bbaaade59a09529f4, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.547747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.584824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 72/138] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:08 2022] PUT /identity/v3/projects/9b51a69660234f48a33ef4579a1470a1/users/08fb641a93854b1bbaaade59a09529f4/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:49:08.648733 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:08.762723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af8ccd-b34a-4989-9bc5-422729cf1290 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:08.814797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f1c2b-5106-4fb1-957d-e60153d32277 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:08.815688 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:08.848109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ea6ac-4e38-41ea-92e9-c2cccdbb1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.849070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ea6ac-4e38-41ea-92e9-c2cccdbb1ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.849358 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ea6ac-4e38-41ea-92e9-c2cccdbb1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.849639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ea6ac-4e38-41ea-92e9-c2cccdbb1ea4 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/08fb641a93854b1bbaaade59a09529f4/roles/286215d5d755461885cd022a8d6d411a` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.852035 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:08.853000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:08.853112 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ea6ac-4e38-41ea-92e9-c2cccdbb1ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32704e1694041efbe1cdb94f6ff9aa8, user_id=08fb641a93854b1bbaaade59a09529f4, role_id=286215d5d755461885cd022a8d6d411a)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.853476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:08.853853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:08.854582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ea6ac-4e38-41ea-92e9-c2cccdbb1ea4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.855242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:08.856826 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:08.858761 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 73/139] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:08.864637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:08.895812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 67/140] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:08 2022] PUT /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/08fb641a93854b1bbaaade59a09529f4/roles/286215d5d755461885cd022a8d6d411a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:08.897706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:08.984337 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78290437-eecc-4834-97b3-f8bfb8295300 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:09.020043 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095c0b6-8cb5-4829-a391-e4a54bb0ecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:09.020944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c0b6-8cb5-4829-a391-e4a54bb0ecee None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:09.021327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c0b6-8cb5-4829-a391-e4a54bb0ecee None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:09.021698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095c0b6-8cb5-4829-a391-e4a54bb0ecee None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:09.022537 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c0b6-8cb5-4829-a391-e4a54bb0ecee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:09.024104 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095c0b6-8cb5-4829-a391-e4a54bb0ecee None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:09.056801 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 74/141] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:08 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:09.146826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf935e-83bd-4826-8933-3e0a809bee4a None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:09.147119 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf935e-83bd-4826-8933-3e0a809bee4a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:09.147413 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf935e-83bd-4826-8933-3e0a809bee4a None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:09.149110 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 68/142] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:09.155478 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:09.156115 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:09.156594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:09.183632 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:09.185111 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:09.262253 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:09.286417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf935e-83bd-4826-8933-3e0a809bee4a None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:09.414473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf935e-83bd-4826-8933-3e0a809bee4a None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:09.449801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:09.450618 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:09.450900 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:09.451174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:09.462300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:09.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:09.478537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:09.482870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 69/144] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:09.484431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:09.504591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:09.612674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915144f-90dc-4364-a316-5eead4b2ba1c None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:09.651716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:09.652789 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:09.653265 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:09.653746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:09.654698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:09.655267 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:09.656900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:09.666377 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 76/145] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:09.672096 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:09.762875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:09.832969 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876e51-23b8-496d-90d6-10a1dbba01f6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:09.872694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:09.873596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:09.873978 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:09.874277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] PATH_INFO: `/v3/users/884e0237f04a4351802e396f8bab85db` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:09.875546 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=884e0237f04a4351802e396f8bab85db)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:09.877091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:09.878774 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 70/146] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:09 2022] GET /identity/v3/users/884e0237f04a4351802e396f8bab85db => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:09.884338 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:09.994065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:10.028082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace7e54-c2fd-4dc2-8346-2dca16625b76 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:10.062921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140088-bffe-4c05-9851-2e273e686dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:10.063799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140088-bffe-4c05-9851-2e273e686dec None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:10.064241 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140088-bffe-4c05-9851-2e273e686dec None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:10.064340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140088-bffe-4c05-9851-2e273e686dec None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:10.065619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94140088-bffe-4c05-9851-2e273e686dec None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:10.067094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94140088-bffe-4c05-9851-2e273e686dec None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:10.069097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 77/147] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:09 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:10.074726 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:10.241746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe80309-35bc-4345-b907-f907ae1fa3a4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:10.273017 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:10.294341 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b859d6-6fe0-4a2a-926a-057f6b5012a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:10.295179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b859d6-6fe0-4a2a-926a-057f6b5012a0 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:10.295460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b859d6-6fe0-4a2a-926a-057f6b5012a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:10.295803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b859d6-6fe0-4a2a-926a-057f6b5012a0 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/884e0237f04a4351802e396f8bab85db/roles/53e9f4ea3ffc4421ba7eda1d180f6fa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:10.297861 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b859d6-6fe0-4a2a-926a-057f6b5012a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32704e1694041efbe1cdb94f6ff9aa8, user_id=884e0237f04a4351802e396f8bab85db, role_id=53e9f4ea3ffc4421ba7eda1d180f6fa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:10.299356 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b859d6-6fe0-4a2a-926a-057f6b5012a0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:10.332920 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e0be3-851a-4b9b-a8bc-662ab15c711e None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:10.333235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 71/148] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:10 2022] PUT /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/users/884e0237f04a4351802e396f8bab85db/roles/53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:10.333468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e0be3-851a-4b9b-a8bc-662ab15c711e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:10.333757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e0be3-851a-4b9b-a8bc-662ab15c711e None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:10.335407 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 78/149] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:10.341265 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:10.341597 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:10.341833 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:10.364033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:10.365296 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:10.450550 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 72/150] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:10.487877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e0be3-851a-4b9b-a8bc-662ab15c711e None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:10.619144 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e0be3-851a-4b9b-a8bc-662ab15c711e None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:10.660245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:10.661105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:10.661383 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:10.661655 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:10.673454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:10.683586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:10.684456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:10.686583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 79/151] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:10.691243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:10.821178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40589e36-b3ce-4216-9b36-c8c130999689 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:10.822845 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:10.871671 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:10.873187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:10.873737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:10.874574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:10.875812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:10.876344 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:10.878040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:10.892430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 73/152] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:10.898004 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:10.903196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:11.016821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc269f-a4db-4ae8-8dbf-9e00b2b3f426 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:11.057340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:11.058633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:11.059120 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:11.059600 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] PATH_INFO: `/v3/users/47b24d52328d4f3cb2e6a6ab9710e538` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:11.062781 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] RBAC: Authorizing `identity:get_user(user_id=47b24d52328d4f3cb2e6a6ab9710e538)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:11.064538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:11.066860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 80/153] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:10 2022] GET /identity/v3/users/47b24d52328d4f3cb2e6a6ab9710e538 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:11.072786 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:11.187553 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51277-0bae-4135-9440-ed4c85f783b7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:11.232683 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:11.233848 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:11.234376 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:11.234857 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:11.279951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:11.320918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:11.322606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:11.445747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 74/154] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:11.451571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:11.534513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:11.577498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e385c2-03ac-4a51-82c8-3396ef8a8934 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:11.618110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4e6b8-8fb4-49f9-92e0-c1c3cb541b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:11.618990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4e6b8-8fb4-49f9-92e0-c1c3cb541b18 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:11.619388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4e6b8-8fb4-49f9-92e0-c1c3cb541b18 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:11.619671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4e6b8-8fb4-49f9-92e0-c1c3cb541b18 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:11.620922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4e6b8-8fb4-49f9-92e0-c1c3cb541b18 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:11.622418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4e6b8-8fb4-49f9-92e0-c1c3cb541b18 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:11.625314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 81/155] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:11 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:11.630250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:11.702012 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:11.754987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529799a-5147-4189-9ee1-cfb0907ad3d6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:11.792748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:11.793415 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:11.793697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:11.793971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:11.794809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=47b24d52328d4f3cb2e6a6ab9710e538) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:11.795108 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:11.796662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2432ae-a04b-43ff-88a3-86ba34c6d71e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:11.805084 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 75/156] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:11 2022] GET /identity/v3/role_assignments?user.id=47b24d52328d4f3cb2e6a6ab9710e538&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=d384469b72f5485190c772f8974438e0 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:12.369376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a5f3-2998-41f4-b50b-1d3f36735187 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:12.369885 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a5f3-2998-41f4-b50b-1d3f36735187 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:12.369982 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a5f3-2998-41f4-b50b-1d3f36735187 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:12.371393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 82/157] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:12.386937 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:12.387417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:12.387487 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:12.413626 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:12.415204 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:12.496507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 76/158] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:12.550155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a5f3-2998-41f4-b50b-1d3f36735187 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:12.673303 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a5f3-2998-41f4-b50b-1d3f36735187 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:12.722255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867d38f-4797-4eb7-800e-baf0603b1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:12.723079 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d38f-4797-4eb7-800e-baf0603b1a34 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:12.723363 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d38f-4797-4eb7-800e-baf0603b1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:12.723635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d38f-4797-4eb7-800e-baf0603b1a34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:12.733529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:12.741211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867d38f-4797-4eb7-800e-baf0603b1a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-a867d38f-4797-4eb7-800e-baf0603b1a34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:12.749105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:12.749962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:12.750768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 83/159] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:12.756340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:12.826816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:12.841232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9da0d-9065-42e0-88e6-caf21188b1dc None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:12.841541 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9da0d-9065-42e0-88e6-caf21188b1dc None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:12.841786 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9da0d-9065-42e0-88e6-caf21188b1dc None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:12.843452 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 84/160] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:49:12.848349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620203-87fa-4147-b11a-707214c23731 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:12.848656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620203-87fa-4147-b11a-707214c23731 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:12.848940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620203-87fa-4147-b11a-707214c23731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:12.876429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f4620203-87fa-4147-b11a-707214c23731 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:12.877696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f4620203-87fa-4147-b11a-707214c23731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:12.910949 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb821c3-9c53-4298-906c-59613e91d659 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:12.980488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:12.981201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:12.981481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:12.981756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:12.982520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:12.982818 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:12.984309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:13.005848 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 77/161] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:13.013024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:13.022478 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 85/162] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:13.065297 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620203-87fa-4147-b11a-707214c23731 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:13.174137 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f76f2-d8e7-43dc-9171-187ee58937f1 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:13.216637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:13.241997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:13.243337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.243823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.244316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.245777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:13.247451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:13.254872 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 78/163] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:13.266423 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:13.283037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620203-87fa-4147-b11a-707214c23731 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:13.315335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:13.326175 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:13.327310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.327310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.327598 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.353875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:13.369723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:13.371032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:13.371820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 86/164] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:13.377360 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:13.477687 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491920c2-bb7f-452a-8432-4c0e08e1b868 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:13.515348 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51d63d-bca0-4a25-8435-763b6c4c5e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:13.516524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51d63d-bca0-4a25-8435-763b6c4c5e4c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.517047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51d63d-bca0-4a25-8435-763b6c4c5e4c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.517549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51d63d-bca0-4a25-8435-763b6c4c5e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.581106 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:13.581543 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275ec8-d9c9-4be0-95be-b64efeced2c7 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:13.591400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51d63d-bca0-4a25-8435-763b6c4c5e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:13.593605 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51d63d-bca0-4a25-8435-763b6c4c5e4c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:13.650270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:13.650960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.651242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.651517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.652273 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:13.652579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:13.654064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1872002-bafa-4f71-b0fa-583443999758 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:13.669187 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 87/165] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:13.669966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd49ec-6be8-403c-af72-921b65bdb8ef None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.670250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd49ec-6be8-403c-af72-921b65bdb8ef None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.670562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd49ec-6be8-403c-af72-921b65bdb8ef None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.671947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 88/166] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:13.677447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd49ec-6be8-403c-af72-921b65bdb8ef None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:13.707458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 79/167] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:49:13.709213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.709709 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.710364 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.737708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:13.740578 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:13.783028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:13.874048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 80/168] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:13.876002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:13.880974 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd49ec-6be8-403c-af72-921b65bdb8ef None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:13.919907 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:13.957398 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:13.958347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:13.958637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:13.958918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:13.960228 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:13.961721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:13.963388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 89/169] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:13.964142 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:14.004316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689dd44-74f3-4bf3-b489-861c17291599 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.042265 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.043227 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.043515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.043787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.045040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:14.046828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:14.048549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 81/170] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:14.049344 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:14.161025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:14.180656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72d63-6ca0-405e-adf3-b0a06501615f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.187362 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd52a5-c972-4848-a2ac-1d42ba54fab6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.202738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:14.219831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.221474 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.222115 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.222620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.235037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:14.244178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:14.245514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:14.246278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:14.250215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 90/171] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:14.257237 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:14.309345 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb589aa-1adf-4850-99f7-33eb0fda1129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.310006 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb589aa-1adf-4850-99f7-33eb0fda1129 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.310285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb589aa-1adf-4850-99f7-33eb0fda1129 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.310553 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb589aa-1adf-4850-99f7-33eb0fda1129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.373236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7554d-6515-4113-b75d-e50c8ffc8894 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.419693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.421309 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.422126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.422627 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.423977 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=08fb641a93854b1bbaaade59a09529f4) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:14.424500 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:14.426698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c3663-ab45-41af-b636-11a2ce27bd09 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:14.440264 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 91/172] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:14 2022] GET /identity/v3/role_assignments?user.id=08fb641a93854b1bbaaade59a09529f4&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:14.447292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300637-d901-43b4-ad87-aa0fdfc8ea91 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.448163 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300637-d901-43b4-ad87-aa0fdfc8ea91 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.450039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8300637-d901-43b4-ad87-aa0fdfc8ea91 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.452879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 92/173] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:14.457694 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8300637-d901-43b4-ad87-aa0fdfc8ea91 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:14.481110 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb589aa-1adf-4850-99f7-33eb0fda1129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:14.484074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb589aa-1adf-4850-99f7-33eb0fda1129 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:14.578652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:14.648770 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8300637-d901-43b4-ad87-aa0fdfc8ea91 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.695372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.696723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.697232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.697734 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.698738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:14.699295 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:14.701226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e71e6-c429-4eba-85ba-18c0b5796e96 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:14.711951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 93/174] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:14.713884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d90a-b93d-4359-b501-5b5ca4ed934e None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.714424 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d90a-b93d-4359-b501-5b5ca4ed934e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.714948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d90a-b93d-4359-b501-5b5ca4ed934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.719731 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:14.739349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 82/175] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:14.740541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626252-5068-409e-ba8c-f6e940fce657 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.740891 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626252-5068-409e-ba8c-f6e940fce657 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.741168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626252-5068-409e-ba8c-f6e940fce657 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.741661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-0463d90a-b93d-4359-b501-5b5ca4ed934e None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:14.742454 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 83/176] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:14.743242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0463d90a-b93d-4359-b501-5b5ca4ed934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:14.745755 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff626252-5068-409e-ba8c-f6e940fce657 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:14.836934 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 94/177] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:14.838700 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0343a-2511-4a20-9a31-420621ec9dca None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.838993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0343a-2511-4a20-9a31-420621ec9dca None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.839272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0343a-2511-4a20-9a31-420621ec9dca None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.840825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 95/178] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:14.841408 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0343a-2511-4a20-9a31-420621ec9dca None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:14.871569 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff626252-5068-409e-ba8c-f6e940fce657 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.878910 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:14.905712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f907e3-3a48-4d01-b4d4-bb527df7acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.906586 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f907e3-3a48-4d01-b4d4-bb527df7acb8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.906872 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f907e3-3a48-4d01-b4d4-bb527df7acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.907145 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f907e3-3a48-4d01-b4d4-bb527df7acb8 None admin] PATH_INFO: `/v3/users/08fb641a93854b1bbaaade59a09529f4` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.908343 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f907e3-3a48-4d01-b4d4-bb527df7acb8 None admin] RBAC: Authorizing `identity:get_user(user_id=08fb641a93854b1bbaaade59a09529f4)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:14.909855 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f907e3-3a48-4d01-b4d4-bb527df7acb8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:14.911521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 84/179] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:14 2022] GET /identity/v3/users/08fb641a93854b1bbaaade59a09529f4 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:14.912744 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b550a-1c02-43eb-888b-d9857ba04db8 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.913028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b550a-1c02-43eb-888b-d9857ba04db8 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.913323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b550a-1c02-43eb-888b-d9857ba04db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.929531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-542b550a-1c02-43eb-888b-d9857ba04db8 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:14.930735 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-542b550a-1c02-43eb-888b-d9857ba04db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:14.943619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0343a-2511-4a20-9a31-420621ec9dca None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:14.979640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:14.983038 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113848e-1a65-4918-b7a8-1ad1d9f45a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:14.983932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113848e-1a65-4918-b7a8-1ad1d9f45a39 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.984209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113848e-1a65-4918-b7a8-1ad1d9f45a39 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.984476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113848e-1a65-4918-b7a8-1ad1d9f45a39 None admin] PATH_INFO: `/v3/projects/9b51a69660234f48a33ef4579a1470a1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:14.985698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113848e-1a65-4918-b7a8-1ad1d9f45a39 None admin] RBAC: Authorizing `identity:get_project(project_id=9b51a69660234f48a33ef4579a1470a1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:14.987136 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113848e-1a65-4918-b7a8-1ad1d9f45a39 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:14.988895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 96/180] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:14 2022] GET /identity/v3/projects/9b51a69660234f48a33ef4579a1470a1 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:14.990029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:14.990301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:14.990571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.003392 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 85/181] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:15.004811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772a7e1-db26-42bf-acfc-b5ce94f4e826 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.005079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772a7e1-db26-42bf-acfc-b5ce94f4e826 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.005373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772a7e1-db26-42bf-acfc-b5ce94f4e826 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.008705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 86/182] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:15.008822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:15.008923 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772a7e1-db26-42bf-acfc-b5ce94f4e826 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.008997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:15.075396 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 97/183] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:15.076255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.113368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.125600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772a7e1-db26-42bf-acfc-b5ce94f4e826 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.163521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.164335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.164645 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.165284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.176175 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:15.178564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f25b-1242-4f60-811a-147f6e76cde1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:15.183836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:15.184812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:15.185698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 87/184] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:15.186410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.217005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.217720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.217999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.218269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.230897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.285891 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:15.287388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:15.293180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b1128-9bcb-423f-8cd5-3ee250ce64f6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.319355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.326523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.327211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.327498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.327770 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.328591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=9b51a69660234f48a33ef4579a1470a1, user.id=08fb641a93854b1bbaaade59a09529f4) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:15.328927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:15.330388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1312ee6-fe21-4b9a-98bd-509e70196689 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:15.336570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 88/185] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/role_assignments?user.id=08fb641a93854b1bbaaade59a09529f4&scope.project.id=9b51a69660234f48a33ef4579a1470a1&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:15.337584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc39453-5620-431b-a213-4639e5377019 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.337856 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc39453-5620-431b-a213-4639e5377019 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.338130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc39453-5620-431b-a213-4639e5377019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.355417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-cbc39453-5620-431b-a213-4639e5377019 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:15.356727 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-cbc39453-5620-431b-a213-4639e5377019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:15.403087 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 98/186] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:15.405435 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.436793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 89/187] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:15.437547 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc39453-5620-431b-a213-4639e5377019 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.481135 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.540873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3616ed-0203-41f9-8e6f-3e7b786ce8b9 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.550574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc39453-5620-431b-a213-4639e5377019 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.582731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.583565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.583841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.584111 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.586136 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.592275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.593216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.593500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.593772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.596926 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:15.603891 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:15.605091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:15.606108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:15.606906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 99/188] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:15.607547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:15.611987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:15.612890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:15.613670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 90/189] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:15.614297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.712042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11afbae-8f2f-4aff-93fc-5e3f72342d17 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.714907 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.718774 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b21b2-343f-4a3a-ade5-195e7f6b76fa None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.745742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.746415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.746696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.746966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.747719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:15.748027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:15.749491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:15.754177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.755047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.755328 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.755603 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.756833 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:15.757619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 100/190] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:15.758279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:15.758402 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.760160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 91/191] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:15.760776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.815569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:15.858890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bf4f3-4a88-40c6-9ebd-9ccdc1b2b876 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.862885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6929-94d4-4913-8a40-62d53faf53c7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:15.893415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.894301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.894601 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.894785 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.896166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:15.896570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:15.897266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:15.897549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:15.897671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:15.897821 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:15.898591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:15.898894 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:15.899305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 101/192] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:15.900062 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.900272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:15.912934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 92/193] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:15.913747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:15.945611 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.010508 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54b93-f066-4cc1-88d4-26f68c4eba0a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.034248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.041340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50f8c6-b631-4be9-b75b-5be0e17269ec None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.046278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.046951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.047235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.047511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.048265 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:16.048576 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.050017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.058520 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 102/194] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:16.063311 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.077822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.078707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.078988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.079281 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] PATH_INFO: `/v3/users/21a42a05d6164e52947738fa62adb8f2` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.092839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] RBAC: Authorizing `identity:get_user(user_id=21a42a05d6164e52947738fa62adb8f2)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.094293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.095992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 93/195] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:15 2022] GET /identity/v3/users/21a42a05d6164e52947738fa62adb8f2 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:16.100709 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.157377 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52531955-188b-4571-b5b7-f2d6ee4d26f6 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.185516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.193001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.193670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.193954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.194233 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.195069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] RBAC: Adding query filter params (role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=08fb641a93854b1bbaaade59a09529f4) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:16.195382 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.196886 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.200934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023be4-2e0e-46aa-8248-3784afda517c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.202693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 103/196] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/role_assignments?user.id=08fb641a93854b1bbaaade59a09529f4&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=286215d5d755461885cd022a8d6d411a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:16.203479 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.248319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.251971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.251971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.251971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.251971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.251971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.266918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.274986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 94/197] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:16 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:16.275663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.357187 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54dc62-f7ef-44e1-bb47-17a2a67ab7db None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.413423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.414314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.415251 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.416159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] PATH_INFO: `/v3/users/21a42a05d6164e52947738fa62adb8f2` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.417525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] RBAC: Authorizing `identity:get_user(user_id=21a42a05d6164e52947738fa62adb8f2)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.419592 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.422714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 104/198] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/users/21a42a05d6164e52947738fa62adb8f2 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:16.425559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.455094 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254e01-d8ef-4f45-879a-411e747c25e6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.504853 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.506202 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.506578 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.506859 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] PATH_INFO: `/v3/users/884e0237f04a4351802e396f8bab85db` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.509251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] RBAC: Authorizing `identity:get_user(user_id=884e0237f04a4351802e396f8bab85db)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.511319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.513563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 95/199] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/users/884e0237f04a4351802e396f8bab85db => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:16.514971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.528732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.556768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cd054-dca2-4fda-adb4-d7574461f110 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.582142 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.606582 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.607219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.607503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.607781 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.637373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0014e8-4443-4e35-ac46-2be4b5937bce None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:16.676137 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:16.677216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:16.677490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:16.677771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:16.693104 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.694919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.770941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:16.772712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:16.788265 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.810986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 105/200] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:16.816203 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.835238 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:16.896223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 96/201] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:16.897434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:16.944677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4807ab-56c3-4fbf-b2ef-544d64241a9b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.002954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.003617 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.003895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.004165 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.012927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9609-8036-439c-9e4d-e06b09f9dfd4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.024580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:17.058083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.059116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.059397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.060058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.061393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.063455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.065988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 97/202] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:17.069453 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:17.087915 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.089916 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.113909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:17.178146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60533-84bd-4f9b-9671-ba0ab65178a4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.218693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 106/203] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:17.219243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.220011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:17.220424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.220837 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.221208 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.222534 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.225297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.227204 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 98/204] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:17 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:17.227817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:17.286446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:17.349827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5a18-e1d8-4a21-a9f6-2462a267c67d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.355023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42cda-ce3f-4745-9eba-572ca54f8f72 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.374354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:17.395310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.395975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.396252 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.396525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.397425 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=21a42a05d6164e52947738fa62adb8f2) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:17.397735 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.398059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.399140 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.399723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.400193 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.401794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.404084 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.406169 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 99/205] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:17 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:17.407222 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:17.410554 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 107/206] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:17 2022] GET /identity/v3/role_assignments?user.id=21a42a05d6164e52947738fa62adb8f2&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=d384469b72f5485190c772f8974438e0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:17.413657 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:17.588445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87ecb-909f-49c4-bf34-344c64183072 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.620087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:17.639037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70851f51-ac2e-4ae3-9ce8-fc9d9c123d8c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:17.651500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.653040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.653531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.654002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.655417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] RBAC: Adding query filter params (role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=21a42a05d6164e52947738fa62adb8f2) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:17.656078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.658213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d26bc-5616-4e9c-8c27-b9e6340b44d5 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.666474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 100/207] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:17 2022] GET /identity/v3/role_assignments?user.id=21a42a05d6164e52947738fa62adb8f2&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=286215d5d755461885cd022a8d6d411a => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:17.711073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:17.711746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:17.712026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:17.712304 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:17.713202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] RBAC: Adding query filter params (role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8, user.id=884e0237f04a4351802e396f8bab85db) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:17.713518 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:17.715099 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5569e-fcb7-4c6d-8861-636a7d518a38 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:17.726219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 108/208] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:17 2022] GET /identity/v3/role_assignments?user.id=884e0237f04a4351802e396f8bab85db&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:18.720156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51fa0-2f8b-4ac3-959c-202028ec1f30 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:18.720705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51fa0-2f8b-4ac3-959c-202028ec1f30 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:18.720815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51fa0-2f8b-4ac3-959c-202028ec1f30 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:18.722124 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 101/209] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:18.727583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbff5-0952-4935-854f-3324a03265f0 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:18.727992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbff5-0952-4935-854f-3324a03265f0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:18.728158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbff5-0952-4935-854f-3324a03265f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:18.758327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-3d7bbff5-0952-4935-854f-3324a03265f0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:18.759866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-3d7bbff5-0952-4935-854f-3324a03265f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:18.817623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:18.844198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 109/210] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:18.869176 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d51fa0-2f8b-4ac3-959c-202028ec1f30 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:18.943880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9705ce-7b4c-4e53-af48-fd0e4e8c1859 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:18.944226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9705ce-7b4c-4e53-af48-fd0e4e8c1859 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:18.944444 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9705ce-7b4c-4e53-af48-fd0e4e8c1859 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:18.947149 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 110/211] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:49:18.951218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:18.951507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:18.951828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:18.970896 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:18.972238 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:18.972526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d51fa0-2f8b-4ac3-959c-202028ec1f30 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.008314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.009962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.009962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.009962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.022409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:19.030493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:19.031437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:19.032231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 102/212] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:19.037463 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.048238 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 111/213] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:19.074115 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.094899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:19.169666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375b87-d417-403a-a412-747a52fa67fb None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.199022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810233-9c2f-4a80-b321-0aa0178fbed6 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.204363 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.205291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.205576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.205851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.206602 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:19.206905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:19.207633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:19.208751 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:19.220288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 103/214] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:19.229179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.245661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.246724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.247006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.247277 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.249047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:19.251022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:19.257734 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 112/215] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:19.260006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.346957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:19.351226 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdfefe-c816-4390-b112-327caa09414f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.361195 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487abad-f4e3-4bde-b3da-187433ff9754 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.389753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.391203 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.391702 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.392170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] PATH_INFO: `/v3/users/2007e7c79f0043909a91b2018dec176a` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.396391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184570b-2773-494f-9e98-088a7603223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.396752 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184570b-2773-494f-9e98-088a7603223a None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.397025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184570b-2773-494f-9e98-088a7603223a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.397297 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184570b-2773-494f-9e98-088a7603223a None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.398001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184570b-2773-494f-9e98-088a7603223a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:19.399520 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184570b-2773-494f-9e98-088a7603223a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:19.409889 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] RBAC: Authorizing `identity:get_user(user_id=2007e7c79f0043909a91b2018dec176a)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:19.412015 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:19.414200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 104/216] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:19 2022] GET /identity/v3/users/2007e7c79f0043909a91b2018dec176a => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:19.420830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.427074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 113/217] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:19 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:19.533993 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eaa2f-28d5-4832-b0c2-c915bc8f1367 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.572479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff017-8b59-4cf2-b986-b06b2c2582c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.573469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff017-8b59-4cf2-b986-b06b2c2582c1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.573885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff017-8b59-4cf2-b986-b06b2c2582c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff017-8b59-4cf2-b986-b06b2c2582c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.611176 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:19.665673 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaff017-8b59-4cf2-b986-b06b2c2582c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:19.667201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaff017-8b59-4cf2-b986-b06b2c2582c1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:19.779259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 105/218] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:49:19.786132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184570b-2773-494f-9e98-088a7603223a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.811266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a930-d575-476d-a170-5f737dc0f6df None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.811886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a930-d575-476d-a170-5f737dc0f6df None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.812751 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a930-d575-476d-a170-5f737dc0f6df None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.815092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 106/219] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:19.820579 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.821278 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.821720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.835221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:19.846629 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:19.847848 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:19.908134 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:19.926167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 107/220] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:19.943981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184570b-2773-494f-9e98-088a7603223a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:19.950827 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:19.994014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:19.995170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:19.995595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:19.996013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:19.998532 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:20.000234 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:20.002717 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 114/221] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:19 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:20.009718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.127821 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666c392-b085-404b-8bfc-324dc7cb497d None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:20.174393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7b37-272b-46ba-a26f-e84a371ba1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:20.175705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7b37-272b-46ba-a26f-e84a371ba1ab None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.176190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7b37-272b-46ba-a26f-e84a371ba1ab None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.176745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7b37-272b-46ba-a26f-e84a371ba1ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.188429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb7b37-272b-46ba-a26f-e84a371ba1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-31bb7b37-272b-46ba-a26f-e84a371ba1ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:20.197198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:20.198082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:20.198868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:20.201709 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 108/222] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:20.207747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff64f5-9a6f-4453-bee4-da106d8363aa None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.208467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff64f5-9a6f-4453-bee4-da106d8363aa None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.208791 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff64f5-9a6f-4453-bee4-da106d8363aa None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.210388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 109/223] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:20.210977 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff64f5-9a6f-4453-bee4-da106d8363aa None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.215724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:20.219854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a8128-935b-48e2-ad37-24b7c5600f53 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:20.261842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:20.262621 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.262999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.263367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.264500 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=2007e7c79f0043909a91b2018dec176a) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:20.264892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:20.266439 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c580df-98fd-4b55-9693-48947eb381b3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:20.271214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:20.272647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 115/224] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:20 2022] GET /identity/v3/role_assignments?user.id=2007e7c79f0043909a91b2018dec176a&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:20.282362 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.282747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.283127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.313146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:20.314332 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:20.334875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff64f5-9a6f-4453-bee4-da106d8363aa None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:20.375275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:20.376394 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.376862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.377274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.378305 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:20.378780 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:20.380425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:20.391213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 110/225] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:20.397234 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.513480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ceff6-d65c-483b-ad19-0c4494686653 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:20.515501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 116/226] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:20.526719 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:20.541861 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.575102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:20.576098 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.576382 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.576708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] PATH_INFO: `/v3/users/21a42a05d6164e52947738fa62adb8f2` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.578179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] RBAC: Authorizing `identity:get_user(user_id=21a42a05d6164e52947738fa62adb8f2)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:20.579636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:20.585689 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 111/227] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:20 2022] GET /identity/v3/users/21a42a05d6164e52947738fa62adb8f2 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:20.591792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.708122 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:20.723495 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc55e3-3132-46d4-84be-16b7869e5bcd None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:20.782090 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cf752-1df9-49f8-8312-7212ca8ecbe5 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:20.809892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:20.810747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.811075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.811355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.824558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:20.825743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:20.826025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:20.826805 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:20.828707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:20.831545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:20.833319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 112/228] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:20 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:20.837755 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:20.839584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:20.857067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:20.858134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:20.858908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:20.861639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 117/229] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:20.882098 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:20.946139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:21.011100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77e5c-44b7-4bb5-ab4c-89f2b94cd669 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:21.056828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:21.057526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:21.057808 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:21.058082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:21.058839 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:21.059144 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:21.060557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:21.076142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38427f-1fad-4a0b-a39b-0e7a50c51fc3 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:21.080647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 118/230] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:21.093762 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:21.119252 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:21.120153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:21.120430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:21.120732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/21a42a05d6164e52947738fa62adb8f2/roles/d384469b72f5485190c772f8974438e0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:21.124353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] RBAC: Authorizing `identity:create_grant(project_id=459a4644fae64ed29b84d1098c8934d1, user_id=21a42a05d6164e52947738fa62adb8f2, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:21.125888 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:21.143286 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 113/231] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:20 2022] PUT /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/21a42a05d6164e52947738fa62adb8f2/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:21.149752 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:21.336243 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8938b7-dc17-4227-929d-5a9948dd7ea3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:21.395388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:21.397448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:21.397448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:21.397448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] PATH_INFO: `/v3/users/21a42a05d6164e52947738fa62adb8f2` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:21.398676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] RBAC: Authorizing `identity:get_user(user_id=21a42a05d6164e52947738fa62adb8f2)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:21.400286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:21.402565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 119/232] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:21 2022] GET /identity/v3/users/21a42a05d6164e52947738fa62adb8f2 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:21.408246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:21.565033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b1b27-0743-4f8a-bc93-1f2b5f8a0345 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:21.572444 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:21.605833 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1857ff-b7e9-45ee-b080-39069fc7b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:21.606641 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1857ff-b7e9-45ee-b080-39069fc7b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:21.606912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1857ff-b7e9-45ee-b080-39069fc7b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:21.607183 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1857ff-b7e9-45ee-b080-39069fc7b3f1 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:21.608531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1857ff-b7e9-45ee-b080-39069fc7b3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:21.610032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1857ff-b7e9-45ee-b080-39069fc7b3f1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:21.612061 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 114/233] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:21 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:21.617791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:21.706775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:21.731749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9804df9-8bc9-44f3-b5af-50ec9c3bc08b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:21.776531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385549de-a98b-4401-9fe4-244e31b3b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:21.777499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385549de-a98b-4401-9fe4-244e31b3b409 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:21.777819 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385549de-a98b-4401-9fe4-244e31b3b409 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:21.778094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385549de-a98b-4401-9fe4-244e31b3b409 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/21a42a05d6164e52947738fa62adb8f2/roles/286215d5d755461885cd022a8d6d411a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:21.780614 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385549de-a98b-4401-9fe4-244e31b3b409 None admin] RBAC: Authorizing `identity:create_grant(project_id=459a4644fae64ed29b84d1098c8934d1, user_id=21a42a05d6164e52947738fa62adb8f2, role_id=286215d5d755461885cd022a8d6d411a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:21.782100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385549de-a98b-4401-9fe4-244e31b3b409 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:21.799746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 120/234] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:21 2022] PUT /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/21a42a05d6164e52947738fa62adb8f2/roles/286215d5d755461885cd022a8d6d411a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:49:22.389788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8d3d-7eda-4a76-be47-a32c766aaf51 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:22.390349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8d3d-7eda-4a76-be47-a32c766aaf51 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:22.390712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8d3d-7eda-4a76-be47-a32c766aaf51 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:22.393256 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 115/235] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:22.401544 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953cd18-8f2e-4f8f-aa57-03f16336dbfb None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:22.402051 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953cd18-8f2e-4f8f-aa57-03f16336dbfb None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:22.402156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953cd18-8f2e-4f8f-aa57-03f16336dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:22.425624 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-0953cd18-8f2e-4f8f-aa57-03f16336dbfb None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:22.426866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0953cd18-8f2e-4f8f-aa57-03f16336dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:22.538511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 121/236] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:22.553301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e31d57-90a3-4832-8ba0-d6e084f8a5f7 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:22.553609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e31d57-90a3-4832-8ba0-d6e084f8a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:22.553855 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e31d57-90a3-4832-8ba0-d6e084f8a5f7 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:22.555397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 116/237] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:22.560741 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:22.561184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:22.561467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:22.569825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e31d57-90a3-4832-8ba0-d6e084f8a5f7 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:22.589630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:22.590853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:22.716843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e31d57-90a3-4832-8ba0-d6e084f8a5f7 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:22.746008 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:22.760050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:22.760929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:22.761210 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:22.761515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:22.765285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:22.766737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:22.768558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 117/239] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:22.774202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:22.776844 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:22.801599 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:22.873229 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:22.961771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540edb-de27-4918-a91b-3c01c6616b4a None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:22.965228 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48867a9d-19c2-45ba-82c5-45552266b1f0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:22.996075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83874118-3e8b-4266-9578-921bfa907f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:22.996806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874118-3e8b-4266-9578-921bfa907f43 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:22.997088 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874118-3e8b-4266-9578-921bfa907f43 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:22.997361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874118-3e8b-4266-9578-921bfa907f43 None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:22.998087 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83874118-3e8b-4266-9578-921bfa907f43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:22.999625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83874118-3e8b-4266-9578-921bfa907f43 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:23.005943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.007224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.008112 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.009015 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.022118 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:23.024895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 123/240] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:22 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:23.026304 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680062c-1f73-411f-bf98-8ae424cad010 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.026625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680062c-1f73-411f-bf98-8ae424cad010 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.026903 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680062c-1f73-411f-bf98-8ae424cad010 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.028790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 124/241] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:23.034870 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.035248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.035588 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:23.036542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:23.037668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:23.038661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:23.041299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 118/242] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:23.054104 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.057305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:23.059683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:23.125289 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:23.141999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:23.196201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.270041 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a76a5-f8b9-4b0f-bfd5-0700733b2fef None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:23.276786 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:23.326400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.327080 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.327365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.327653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.329054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:23.329373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:23.331070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:23.344679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 119/244] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:23.350268 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.375081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af727f5e-49ab-42c5-90dd-b36b5511055d None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:23.418623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.419442 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.419728 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.420000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.432664 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:23.440645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:23.441555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:23.442366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 126/245] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:23.449413 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.486974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9561e-eb28-4aa0-8206-90bf9fb1e806 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:23.508912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:23.535191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.537171 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.537458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.537731 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] PATH_INFO: `/v3/users/f8fcd9ab0cfb436eb3499ec9f17092be` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.557828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] RBAC: Authorizing `identity:get_user(user_id=f8fcd9ab0cfb436eb3499ec9f17092be)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:23.559694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:23.567412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 120/246] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/users/f8fcd9ab0cfb436eb3499ec9f17092be => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:23.568957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.582301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c9ac4-87bc-44d6-a3ec-cc160937157a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:23.600854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:23.629212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.629904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.630185 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.630512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.631278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:23.631586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:23.633428 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:23.648524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 127/247] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:23.649488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.703560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da31b-1873-4c4c-b1c6-218c013163e0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:23.742631 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.743293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.743574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.743851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.766476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6341bc-1f8c-42ce-b96b-43838e60cd55 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:23.778800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:23.807936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:23.809208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:23.809628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:23.810032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] PATH_INFO: `/v3/users/2007e7c79f0043909a91b2018dec176a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:23.811641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2007e7c79f0043909a91b2018dec176a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:23.813447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:23.815913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 128/248] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/users/2007e7c79f0043909a91b2018dec176a => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:23.824320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.826170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:23.827956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:23.859634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:23.945723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 121/249] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:23.951580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:23.957257 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4c73b-f3c5-4118-af2c-00b923a021c4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:24.002880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:24.003767 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.004371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.004676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.006609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:24.008077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:24.010075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 129/250] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:24.020258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:24.105011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:24.140471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdab28-5e9e-46dd-823f-88be65d5911e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:24.173946 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:24.186551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b6844-7897-4a90-b634-8a13cccf6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:24.187430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6844-7897-4a90-b634-8a13cccf6f7b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.187708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6844-7897-4a90-b634-8a13cccf6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.187978 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6844-7897-4a90-b634-8a13cccf6f7b None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.189214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b6844-7897-4a90-b634-8a13cccf6f7b None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:24.190819 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b6844-7897-4a90-b634-8a13cccf6f7b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:24.192563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 122/251] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:23 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:24.193766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5d0ff-9e78-4bce-b376-40b1fde4e633 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.194050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5d0ff-9e78-4bce-b376-40b1fde4e633 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.194324 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5d0ff-9e78-4bce-b376-40b1fde4e633 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.200628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 123/252] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:24.201386 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5d0ff-9e78-4bce-b376-40b1fde4e633 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:24.247553 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa58b-7507-421a-9af2-dd1674ff6199 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:24.317614 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01dfee-972d-440a-b52e-309cda5f996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:24.318576 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01dfee-972d-440a-b52e-309cda5f996c None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.318859 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01dfee-972d-440a-b52e-309cda5f996c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.319134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01dfee-972d-440a-b52e-309cda5f996c None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/2007e7c79f0043909a91b2018dec176a/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.322101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01dfee-972d-440a-b52e-309cda5f996c None admin] RBAC: Authorizing `identity:create_grant(project_id=459a4644fae64ed29b84d1098c8934d1, user_id=2007e7c79f0043909a91b2018dec176a, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:24.330888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01dfee-972d-440a-b52e-309cda5f996c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:24.364686 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5d0ff-9e78-4bce-b376-40b1fde4e633 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:24.374584 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 130/253] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:24 2022] PUT /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/2007e7c79f0043909a91b2018dec176a/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:24.375914 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8627c7-9deb-4af6-80a1-af1777309145 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.376207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8627c7-9deb-4af6-80a1-af1777309145 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.376485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8627c7-9deb-4af6-80a1-af1777309145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.408180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:24.409317 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.409872 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.410596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.411934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] RBAC: Adding query filter params (role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=f8fcd9ab0cfb436eb3499ec9f17092be) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:24.412583 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:24.413838 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-bd8627c7-9deb-4af6-80a1-af1777309145 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:24.415202 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:24.415469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-bd8627c7-9deb-4af6-80a1-af1777309145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:24.424156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 124/254] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:24 2022] GET /identity/v3/role_assignments?user.id=f8fcd9ab0cfb436eb3499ec9f17092be&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:24.538208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 131/255] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:24.586819 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:24.663420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:24.722311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9f282-9e4e-4e21-af3a-d8f074ac2244 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:24.759956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:24.760800 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.761115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.761679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.763347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9afd0-d81d-435d-8a6a-3d7ee6f0240b None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.763633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9afd0-d81d-435d-8a6a-3d7ee6f0240b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.763910 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9afd0-d81d-435d-8a6a-3d7ee6f0240b None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.765718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 132/256] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:24.773114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:24.776177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.776457 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.778040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:24.780803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:24.781684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:24.782458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 125/257] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:24.789074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:24.821727 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:24.822950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:24.882530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:24.906681 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06def0f-7a3f-4bc5-b04e-0c55dab0b0c5 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:24.929063 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:24.944816 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 133/258] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:24.947617 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:24.948461 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:24.948919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:24.949590 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:24.950478 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:24.950930 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:24.952559 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:24.961615 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 126/259] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:24.968070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:24.981269 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:25.126949 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ae3c-bee8-4f79-899b-0f277feaf3fe None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:25.163023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:25.164188 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:25.165043 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:25.165584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:25.177760 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:25.186912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:25.187787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:25.188555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:25.191425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 127/260] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:25.198032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:25.198610 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8a517-a403-45ec-97fb-9d07de4428da None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:25.280975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:25.281337 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:25.282259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:25.282538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:25.282812 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] PATH_INFO: `/v3/users/21a42a05d6164e52947738fa62adb8f2` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:25.289399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] RBAC: Authorizing `identity:get_user(user_id=21a42a05d6164e52947738fa62adb8f2)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:25.291266 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:25.293074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 134/261] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:24 2022] GET /identity/v3/users/21a42a05d6164e52947738fa62adb8f2 => generated 283 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:25.301551 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:25.368963 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:25.427308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69af04-e5be-4a0a-bc21-1724ac3456d2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:25.510648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0f9c8-3198-4578-b7d1-50ab6e562c69 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:25.517330 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:25.518023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:25.518308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:25.518586 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:25.519352 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:25.519661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:25.521120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:25.532710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 128/262] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:25.540132 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:25.578765 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:25.579503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:25.579714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:25.579992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:25.680177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:25.693960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:25.744950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:25.762960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:25.768886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c372c-5038-4a88-8a61-957119ca91de None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:25.825823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 135/263] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:25.831482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:25.869290 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:25.870191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:25.870490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:25.870801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] PATH_INFO: `/v3/users/21a42a05d6164e52947738fa62adb8f2` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:25.877497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=21a42a05d6164e52947738fa62adb8f2)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:25.879076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:25.880831 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 129/264] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:25 2022] GET /identity/v3/users/21a42a05d6164e52947738fa62adb8f2 => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:25.886678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:26.025999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ae2a4-082c-4f81-a6fa-29d3c1555d70 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:26.093777 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:26.094679 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.094957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.095234 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.096504 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:26.098491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:26.100560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 136/265] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:25 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:26.106328 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:26.110514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:26.191359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce4c6-56f2-4df2-b7e0-8badd379e8e8 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:26.297743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e313dd-79ab-452e-af75-01a55c568979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:26.298334 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e313dd-79ab-452e-af75-01a55c568979 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.298507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0813b0-c3c8-4a77-9cdf-6d72bdb53506 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:26.298606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e313dd-79ab-452e-af75-01a55c568979 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.298886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e313dd-79ab-452e-af75-01a55c568979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.365323 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:26.365999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.366280 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.366555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.367387 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=21a42a05d6164e52947738fa62adb8f2) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:26.367696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:26.371868 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:26.378915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:26.382873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 137/266] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:26 2022] GET /identity/v3/role_assignments?user.id=21a42a05d6164e52947738fa62adb8f2&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=d384469b72f5485190c772f8974438e0 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:26.446734 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e313dd-79ab-452e-af75-01a55c568979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:26.448274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e313dd-79ab-452e-af75-01a55c568979 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:26.610381 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 130/267] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:26.615842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:26.739212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:26.744389 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae9e1-ffe9-47e3-8b39-dcf4552cb6c9 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.744700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae9e1-ffe9-47e3-8b39-dcf4552cb6c9 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.744982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae9e1-ffe9-47e3-8b39-dcf4552cb6c9 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.746683 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 131/268] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:26.782185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d39e-eab8-41c8-981b-bfe44c369f53 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.782795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d39e-eab8-41c8-981b-bfe44c369f53 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.782892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502e05-d409-42a3-b85a-4d7302bd916e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:26.782967 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d39e-eab8-41c8-981b-bfe44c369f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.821694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-77d9d39e-eab8-41c8-981b-bfe44c369f53 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:26.822897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-77d9d39e-eab8-41c8-981b-bfe44c369f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:26.827920 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf8e2-ba1e-4506-a300-5d90776faff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:26.828835 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf8e2-ba1e-4506-a300-5d90776faff7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.829124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf8e2-ba1e-4506-a300-5d90776faff7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.829394 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf8e2-ba1e-4506-a300-5d90776faff7 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.831534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf8e2-ba1e-4506-a300-5d90776faff7 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:26.833035 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf8e2-ba1e-4506-a300-5d90776faff7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:26.835079 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 138/269] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:26 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:26.836316 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68cd68-6fdb-43c9-98a9-c28e273633a1 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.836595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68cd68-6fdb-43c9-98a9-c28e273633a1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.836885 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68cd68-6fdb-43c9-98a9-c28e273633a1 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.838613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 139/270] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:26.840893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68cd68-6fdb-43c9-98a9-c28e273633a1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:26.899019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:26.907761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 132/271] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:26.918354 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:26.918652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:26.925004 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:26.946159 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:26.947366 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:26.954943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68cd68-6fdb-43c9-98a9-c28e273633a1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.008141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.009240 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.009522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.009799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.010630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] RBAC: Adding query filter params (role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=21a42a05d6164e52947738fa62adb8f2) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:27.010941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.012406 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.015083 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.021092 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 140/272] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:26 2022] GET /identity/v3/role_assignments?user.id=21a42a05d6164e52947738fa62adb8f2&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=286215d5d755461885cd022a8d6d411a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:27.022305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.044725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 133/273] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:27.072710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.131620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ec25b-33cb-4c8c-a51f-039ed8a28039 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.168870 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.169609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.169888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.170162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.171460 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.172972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.179166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 141/274] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:27.191793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5120d-b823-44ef-a936-2b0c7c9d1063 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.194142 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.225810 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.238008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.239257 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.239726 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.240187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.267841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:27.284395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:27.285365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:27.286148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 134/275] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:27.297681 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.297897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.337450 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787ca3-8667-4b9a-9094-c8c3c2ae14d0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.375631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc315d-499b-45ea-a649-ed6a03b94277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.376330 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc315d-499b-45ea-a649-ed6a03b94277 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.376634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc315d-499b-45ea-a649-ed6a03b94277 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.378811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc315d-499b-45ea-a649-ed6a03b94277 None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.379587 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc315d-499b-45ea-a649-ed6a03b94277 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.381116 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc315d-499b-45ea-a649-ed6a03b94277 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.416538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 142/276] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:27 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:49:27.418316 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5302c-558b-460c-86cb-2f113f85011b None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.418800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5302c-558b-460c-86cb-2f113f85011b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.419326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5302c-558b-460c-86cb-2f113f85011b None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.421118 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 143/277] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:27.427932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.428586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.429174 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.453180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:27.454417 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:27.479315 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27978-5cab-4b6d-968d-0de1c75e9281 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.525164 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.526282 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.526762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.527263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.528462 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:27.529339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.531026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.542412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 135/278] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:27.544283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 144/279] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:27.549991 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.571455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.619414 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.638168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.694196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15281a-b0bc-47d1-9d14-5d9b3ff8a8cc None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.697694 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf1139-030f-4413-acab-4cb58f054d0c None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.736041 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.737216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.737649 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.738181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] PATH_INFO: `/v3/users/833fb179bb5644a38e38905b9246f944` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.740109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.740951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.742030 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.742030 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.752803 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:27.755168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] RBAC: Authorizing `identity:get_user(user_id=833fb179bb5644a38e38905b9246f944)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.756828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.759032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 136/280] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/users/833fb179bb5644a38e38905b9246f944 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:27.760545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:27.761557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:27.762339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:27.763131 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 145/281] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:27.767822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.769990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.906235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf856e-6d3d-4527-99f8-b30ed98a5bd0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.919363 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d8412-3c6f-489c-b4fa-27847e53563a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:27.923153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.930406 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:27.949345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.949950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.950231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.950625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.951510 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:27.951913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.953379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.964545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 146/282] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:27.968841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:27.969519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:27.969798 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:27.970070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:27.970907 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, user.id=833fb179bb5644a38e38905b9246f944, scope.system=all) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:27.971216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:27.973521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e577429-35b6-4c96-8c43-e20892c08aba None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:27.975480 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:27.986473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 137/283] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/role_assignments?user.id=833fb179bb5644a38e38905b9246f944&scope.system=all&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:28.027004 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b914-7f8d-4db3-baaa-1a92e84c4c83 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.027293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b914-7f8d-4db3-baaa-1a92e84c4c83 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.027576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b914-7f8d-4db3-baaa-1a92e84c4c83 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.029218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 138/284] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:49:28.035624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.035907 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.036186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.055254 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:28.056678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:28.096234 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ecb13-a17a-4ad2-99af-faf65685798d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.133654 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 139/285] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:28.138077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.139041 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.139322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.139591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] PATH_INFO: `/v3/users/f8fcd9ab0cfb436eb3499ec9f17092be` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.140969 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] RBAC: Authorizing `identity:get_user(user_id=f8fcd9ab0cfb436eb3499ec9f17092be)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:28.142454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:28.144552 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 147/286] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:27 2022] GET /identity/v3/users/f8fcd9ab0cfb436eb3499ec9f17092be => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:28.150211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:28.160411 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:28.245478 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:28.355823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:28.357762 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346bcb2-5440-4f6e-ae1c-00f0623b66c0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.363775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62025c1-5f91-4165-8dff-72025ed4c5d0 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.401957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.402864 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.403146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.403416 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.415666 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:28.423441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.424327 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:28.424458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:28.425287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:28.426720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:28.427549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.427549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.427668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 148/287] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:28.427732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:28.430000 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:28.431637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:28.434701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 140/288] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:28 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:28.436408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:28.562011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b02d0-ef93-449d-a91d-d896f8ee12ea None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.564908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:28.632951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec0b0-c820-4fba-8a95-934f8b692d69 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.642228 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.642911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.643188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.643499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.644217 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:28.644518 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:28.646025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:28.664422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 149/289] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:28.670157 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:28.682248 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.683168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.683454 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.683727 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/f8fcd9ab0cfb436eb3499ec9f17092be/roles/53e9f4ea3ffc4421ba7eda1d180f6fa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.689951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] RBAC: Authorizing `identity:create_grant(project_id=459a4644fae64ed29b84d1098c8934d1, user_id=f8fcd9ab0cfb436eb3499ec9f17092be, role_id=53e9f4ea3ffc4421ba7eda1d180f6fa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:28.691441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:28.718842 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 141/290] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:49:28 2022] PUT /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1/users/f8fcd9ab0cfb436eb3499ec9f17092be/roles/53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:28.778655 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d34e3d-bb1c-411d-80b9-a05c70530056 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.825461 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.826706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.827156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.827629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] PATH_INFO: `/v3/users/2007e7c79f0043909a91b2018dec176a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:28.829091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] RBAC: Authorizing `identity:get_user(user_id=2007e7c79f0043909a91b2018dec176a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:28.830745 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:28.832708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 150/291] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:28 2022] GET /identity/v3/users/2007e7c79f0043909a91b2018dec176a => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:28.838535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:28.873681 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:28.953250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb2a73-5500-4ff7-ad8a-7bd518a846cc None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:28.990687 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:28.991766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:28.992247 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:28.992728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:29.065211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:29.067035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:29.097157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:29.171409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 142/292] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:29.177483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:29.210390 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:29.301058 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de226-41cd-426a-8cef-3610f1927361 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:29.348562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60be77c-dc57-4cbb-b5f5-6f9dc6ac68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:29.349799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60be77c-dc57-4cbb-b5f5-6f9dc6ac68fb None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:29.350261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60be77c-dc57-4cbb-b5f5-6f9dc6ac68fb None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:29.350710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60be77c-dc57-4cbb-b5f5-6f9dc6ac68fb None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:29.352220 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60be77c-dc57-4cbb-b5f5-6f9dc6ac68fb None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:29.353940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60be77c-dc57-4cbb-b5f5-6f9dc6ac68fb None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:29.356255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 151/293] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:29 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:29.365757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:29.489210 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d1b7-2391-492c-9d99-5e2ea9799507 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:29.516123 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:29.533856 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:29.534684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:29.534975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:29.535249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:29.536085 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=2007e7c79f0043909a91b2018dec176a) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:29.536392 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:29.537888 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88582620-3714-4fb2-90bb-d4b2528e17d7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:29.544549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 143/294] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:29 2022] GET /identity/v3/role_assignments?user.id=2007e7c79f0043909a91b2018dec176a&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:30.178647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d998e-3aa5-409c-afab-282e463d77a2 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.179168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d998e-3aa5-409c-afab-282e463d77a2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.179168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d998e-3aa5-409c-afab-282e463d77a2 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.180862 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 152/295] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:30.186292 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee8e0-9a0f-40b9-a37f-ec411208d2e7 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.186741 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee8e0-9a0f-40b9-a37f-ec411208d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.186832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee8e0-9a0f-40b9-a37f-ec411208d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.203887 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-eadee8e0-9a0f-40b9-a37f-ec411208d2e7 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:30.205147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-eadee8e0-9a0f-40b9-a37f-ec411208d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:30.281552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 144/296] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:30.306300 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d998e-3aa5-409c-afab-282e463d77a2 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:30.462071 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:30.479633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d998e-3aa5-409c-afab-282e463d77a2 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:30.565483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:30.566361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.566644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.566921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.578268 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae006d9-2762-4ae9-9479-24f9e7768edb None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.578747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae006d9-2762-4ae9-9479-24f9e7768edb None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.579158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae006d9-2762-4ae9-9479-24f9e7768edb None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.580899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 145/297] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:30.583731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:30.585946 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ad86-dcb7-4db9-95d1-a07ef262cb29 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.586403 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ad86-dcb7-4db9-95d1-a07ef262cb29 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.586841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ad86-dcb7-4db9-95d1-a07ef262cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:30.591923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:30.592883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:30.593641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:30.599613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 153/298] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:30.600528 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:30.624915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b6b2ad86-dcb7-4db9-95d1-a07ef262cb29 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:30.626139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b6b2ad86-dcb7-4db9-95d1-a07ef262cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:30.711765 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 146/299] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:30.718096 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702f31-e7fa-4b63-a023-2fd803ffd053 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.718325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702f31-e7fa-4b63-a023-2fd803ffd053 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.718603 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702f31-e7fa-4b63-a023-2fd803ffd053 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.719962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 147/300] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:30.732999 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.733289 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.733564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.734539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c3040-2127-44c3-9355-d1e8056c220c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:30.750868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:30.752505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:30.794288 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:30.795047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.795428 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.795763 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.796883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:30.797194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:30.798922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:30.810485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:30.813456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 154/301] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:30.815001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:30.844640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 148/302] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:30.845685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:30.846817 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:30.942326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901ab99-0d7a-479d-b497-968c07ff2cd7 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:30.956158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a120-8103-49a2-8b00-c106e54c23bd None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:30.977491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:30.978226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.978502 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.978776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:30.979942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:30.981426 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:30.983101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 155/303] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:30.984769 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:30.996318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:30.997236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:30.997526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:30.997995 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] PATH_INFO: `/v3/users/386b588d45a7473591286360effab99b` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.011651 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] RBAC: Authorizing `identity:get_user(user_id=386b588d45a7473591286360effab99b)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:31.013271 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:31.019804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 149/304] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:30 2022] GET /identity/v3/users/386b588d45a7473591286360effab99b => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:31.019804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:31.065657 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:31.090348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:31.101584 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3956c0-4430-474a-943a-9f5f23175c2d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.134830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99854a-b776-4d8c-a22b-93b05f4e0ece None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.136317 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.137155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.138065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.138065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.148593 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:31.156380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:31.157368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:31.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 156/305] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:31.158880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:31.178264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.178940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.179219 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.179631 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] PATH_INFO: `/v3/groups` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.180172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:31.181647 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:31.198666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 150/306] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Jul 23 20:49:31 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:31.200235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:31.309889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80a569-32e0-4a19-9513-2a26f8f4c459 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.325106 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:31.329173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61cec-dfcf-4b3b-9132-d91649a687e4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.363040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.363768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.364408 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.364712 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.365577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] RBAC: Adding query filter params (role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8, user.id=386b588d45a7473591286360effab99b, scope.system=all) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:31.365890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:31.367737 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:31.369499 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.370442 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.370919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.371404 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.372468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:31.373008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:31.374431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 157/307] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jul 23 20:49:31 2022] GET /identity/v3/role_assignments?user.id=386b588d45a7473591286360effab99b&scope.system=all&role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:31.375450 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:31.390400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 151/308] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:31.399622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:31.422012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:31.529981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d1cd-6e6e-4828-8020-7b6dc649780b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.568082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09109f13-8bb2-43ca-9aea-7b651317a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.569021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109f13-8bb2-43ca-9aea-7b651317a503 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.569305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109f13-8bb2-43ca-9aea-7b651317a503 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.569578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109f13-8bb2-43ca-9aea-7b651317a503 None admin] PATH_INFO: `/v3/users/833fb179bb5644a38e38905b9246f944` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.570842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09109f13-8bb2-43ca-9aea-7b651317a503 None admin] RBAC: Authorizing `identity:get_user(user_id=833fb179bb5644a38e38905b9246f944)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:31.572327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09109f13-8bb2-43ca-9aea-7b651317a503 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:31.574223 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 158/309] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:31 2022] GET /identity/v3/users/833fb179bb5644a38e38905b9246f944 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:31.579878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:31.694748 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b92621-5948-4fcb-9b9f-0fc2d8f5bacc None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.695075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b92621-5948-4fcb-9b9f-0fc2d8f5bacc None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.695264 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b92621-5948-4fcb-9b9f-0fc2d8f5bacc None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.696996 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 159/310] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:31.698894 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226e89-48ef-4872-b939-98b6ffc2c6fb None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.701814 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.702404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.702883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.721244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:31.722854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:31.739434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.740326 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.740659 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.741172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] PATH_INFO: `/v3/system/users/833fb179bb5644a38e38905b9246f944/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:31.742951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=833fb179bb5644a38e38905b9246f944, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:31.744764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:31.757096 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 152/311] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jul 23 20:49:31 2022] PUT /identity/v3/system/users/833fb179bb5644a38e38905b9246f944/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:31.808697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 160/312] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:31.833471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:31.864948 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:31.948146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebef9-2c3a-4f96-b926-575c96e14ec5 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:31.987972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:31.988829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:31.989112 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:31.989387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:32.000809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:32.008660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:32.009596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:32.010433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 153/313] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:32.017837 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:32.046347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:32.127573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c7f77-04cc-4bd9-93c8-16f9760249cf None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:32.162911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:32.163932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:32.164354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:32.165134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:32.166040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:32.166487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:32.168026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:32.177357 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 161/314] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:32.184714 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:32.272308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:32.301194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b4d8-ae40-4aa1-89b4-add2a1c70128 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:32.336787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:32.337677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:32.337959 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:32.338233 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] PATH_INFO: `/v3/users/f8fcd9ab0cfb436eb3499ec9f17092be` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:32.339446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=f8fcd9ab0cfb436eb3499ec9f17092be)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:32.340943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:32.342954 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 154/315] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:32 2022] GET /identity/v3/users/f8fcd9ab0cfb436eb3499ec9f17092be => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:32.348593 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:32.429349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:32.451110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8999d5-a29b-4c3d-bee6-7452ec9cd8a1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:32.484959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:32.485611 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:32.485889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:32.486159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:32.556574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:32.558191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:32.634995 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:32.661266 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 162/316] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:32.669715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:32.768419 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e8982-d9f1-453e-8faa-e15269aae8a7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:32.801050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136636b-2264-4530-bd46-24df23ce4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:32.802104 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136636b-2264-4530-bd46-24df23ce4e37 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:32.802538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136636b-2264-4530-bd46-24df23ce4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:32.802966 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136636b-2264-4530-bd46-24df23ce4e37 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:32.804287 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136636b-2264-4530-bd46-24df23ce4e37 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:32.805911 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136636b-2264-4530-bd46-24df23ce4e37 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:32.808050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 155/317] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:32 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:32.814122 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:32.916771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eac1d-0a80-46e1-a504-bcf14948ea3c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:32.949929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:32.950920 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:32.951425 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:32.951937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:32.952997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] RBAC: Adding query filter params (role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8, scope.project.id=459a4644fae64ed29b84d1098c8934d1, user.id=f8fcd9ab0cfb436eb3499ec9f17092be) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:32.953500 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:32.955155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7004-8d4a-431d-aa08-55f917cd297e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:32.962619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 163/318] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:49:32 2022] GET /identity/v3/role_assignments?user.id=f8fcd9ab0cfb436eb3499ec9f17092be&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:33.678935 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d976c2-0233-4a00-aebf-ab6a91c2aa24 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:33.679516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d976c2-0233-4a00-aebf-ab6a91c2aa24 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:33.679516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d976c2-0233-4a00-aebf-ab6a91c2aa24 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:33.681381 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 156/319] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:33.687653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:33.688156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:33.688236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:33.706369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:33.707584 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:33.740023 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:33.751518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49648ae0-9586-4fd7-acd2-68717d1864a4 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:33.751812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49648ae0-9586-4fd7-acd2-68717d1864a4 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:33.752070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49648ae0-9586-4fd7-acd2-68717d1864a4 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:33.753657 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 157/320] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:33.758482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:33.758768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:33.759045 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:33.775943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:33.777163 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:33.782665 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 164/321] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:33.799501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:33.806522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:33.855404 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 158/322] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:33.879892 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:33.915384 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e273-2b08-4135-9e7d-7681ac280c8a None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:33.955633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:33.956349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:33.956640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:33.956935 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:33.958127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:33.959718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:33.961572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 165/323] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:33.967350 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:33.989337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723d14-f918-4f4f-8934-67ffbcbfa289 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.007276 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:34.032906 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.033696 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.033976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.034255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.048763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:34.062883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:34.063814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:34.064653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 159/324] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:34.070087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:34.084555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74594f-ac18-4839-a9b6-b07fdf30a3d1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.086116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:34.122329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b8168-9263-4a28-ab38-4d1b8884edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.123992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8168-9263-4a28-ab38-4d1b8884edd9 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.124499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8168-9263-4a28-ab38-4d1b8884edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.124802 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8168-9263-4a28-ab38-4d1b8884edd9 None admin] PATH_INFO: `/v3/groups` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.125579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b8168-9263-4a28-ab38-4d1b8884edd9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:34.127060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b8168-9263-4a28-ab38-4d1b8884edd9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:34.151270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 166/325] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Jul 23 20:49:33 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:49:34.151270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57cf8-368b-4056-951f-37424dfea076 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.151270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57cf8-368b-4056-951f-37424dfea076 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.151270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57cf8-368b-4056-951f-37424dfea076 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.151270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 167/326] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:34.152692 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.153227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.153227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.178668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:34.179904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:34.195717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1943-453b-4096-a9ac-74d2e1d105b1 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.247916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.248732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.253076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.253076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.253076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:34.253076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:34.253076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:34.267293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 160/327] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:34.268662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:34.285145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 168/328] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:34.306339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:34.341063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:34.369795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:34.415472 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534adf1-2611-445c-84c6-b4541aa768ac None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.433527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2529-e05f-41d4-b166-b742e10a4fde None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.466077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.466511 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.466790 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.467100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] PATH_INFO: `/v3/users/386b588d45a7473591286360effab99b` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.468375 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] RBAC: Authorizing `identity:get_user(user_id=386b588d45a7473591286360effab99b)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:34.469958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:34.471998 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 161/329] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:34 2022] GET /identity/v3/users/386b588d45a7473591286360effab99b => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:34.477693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.478807 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.478946 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:34.479128 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.479354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.498431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:34.506901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:34.507806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:34.508581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 169/330] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:34.515191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:34.613434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986a785-1fb0-47ed-83fd-18b486b50bed None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.640252 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:34.666144 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73765dbb-9255-4846-8840-46ad6f601402 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.673430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.674429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.674711 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.674984 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] PATH_INFO: `/v3/system/users/386b588d45a7473591286360effab99b/roles/53e9f4ea3ffc4421ba7eda1d180f6fa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.677068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=386b588d45a7473591286360effab99b, role_id=53e9f4ea3ffc4421ba7eda1d180f6fa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:34.678881 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:34.693916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 162/331] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jul 23 20:49:34 2022] PUT /identity/v3/system/users/386b588d45a7473591286360effab99b/roles/53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:49:34.720022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.720766 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.721056 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.721333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.722126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:34.722456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:34.724622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:34.740113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 170/332] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:34.747168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:34.759507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:34.877960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018c148-59ac-4385-a694-8e1bbb0d2fff None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:34.922349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c8106-87cc-4852-8116-b1a67951a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:34.923255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8106-87cc-4852-8116-b1a67951a3ac None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:34.923535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8106-87cc-4852-8116-b1a67951a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:34.923811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8106-87cc-4852-8116-b1a67951a3ac None admin] PATH_INFO: `/v3/users/833fb179bb5644a38e38905b9246f944` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:34.926225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c8106-87cc-4852-8116-b1a67951a3ac None admin] RBAC: Authorizing `identity:get_user(user_id=833fb179bb5644a38e38905b9246f944)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:34.927718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c8106-87cc-4852-8116-b1a67951a3ac None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:34.929544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 163/333] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:34 2022] GET /identity/v3/users/833fb179bb5644a38e38905b9246f944 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:34.936689 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:35.048646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702d546-424a-415b-9519-ca950d7340f1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:35.085091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:35.085756 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:35.086036 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:35.086310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:35.087198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] RBAC: Adding query filter params (role.id=87f72d0ef80748d3944fa5d7e9d022a0, user.id=833fb179bb5644a38e38905b9246f944, scope.system=all) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:35.087507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:35.089047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2746c-aad8-4186-986f-50282043f92a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:35.102451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 171/334] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jul 23 20:49:34 2022] GET /identity/v3/role_assignments?user.id=833fb179bb5644a38e38905b9246f944&scope.system=all&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:37.326160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaed30-289b-4bcb-a2b9-9e35d6512830 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.326750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaed30-289b-4bcb-a2b9-9e35d6512830 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.326750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaed30-289b-4bcb-a2b9-9e35d6512830 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.328340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 164/335] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:37.334404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.334943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.334943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.348580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:37.358368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:37.359593 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:37.393324 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8dfe-14b7-475a-b15b-ccf5c649fec5 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.393638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8dfe-14b7-475a-b15b-ccf5c649fec5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.393903 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8dfe-14b7-475a-b15b-ccf5c649fec5 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.395577 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 165/336] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:49:37.400999 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.401277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.401545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.420319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:37.421634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:37.487711 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 172/337] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:37.512088 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 166/338] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:37.537623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:37.539174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:37.554285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:37.685334 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af542f-7926-4f5a-9e8d-0b419c9adc29 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:37.731082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136e1fc-c8d4-4b9f-a293-6ce66c46db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:37.731997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136e1fc-c8d4-4b9f-a293-6ce66c46db03 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.732280 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136e1fc-c8d4-4b9f-a293-6ce66c46db03 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.732570 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136e1fc-c8d4-4b9f-a293-6ce66c46db03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.735611 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:37.745925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136e1fc-c8d4-4b9f-a293-6ce66c46db03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:37.748875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a5dfd-f897-48f5-b478-2de542a0ddf1 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c136e1fc-c8d4-4b9f-a293-6ce66c46db03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:37.753925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:37.754821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:37.756068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 173/339] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:37.760538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd75d55-a625-4dce-91c6-bf230947aa09 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.760879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd75d55-a625-4dce-91c6-bf230947aa09 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.761156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd75d55-a625-4dce-91c6-bf230947aa09 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.763074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 174/340] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:37.765278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd75d55-a625-4dce-91c6-bf230947aa09 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:37.799420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95d39e-5f67-4825-bdf5-3ad4b55099ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:37.800256 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d39e-5f67-4825-bdf5-3ad4b55099ef None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.800538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d39e-5f67-4825-bdf5-3ad4b55099ef None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.800853 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d39e-5f67-4825-bdf5-3ad4b55099ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.812200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95d39e-5f67-4825-bdf5-3ad4b55099ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-3f95d39e-5f67-4825-bdf5-3ad4b55099ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:37.820429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:37.822663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 167/341] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:37.824635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.826721 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.826721 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.842113 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:37.843324 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:37.885184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd75d55-a625-4dce-91c6-bf230947aa09 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:37.912509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:37.921759 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 168/342] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:37.922632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:37.925046 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:37.925820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:37.926097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:37.926367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:37.927123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:37.927422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:37.929895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:37.943605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 175/343] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:37.949396 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.058213 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.112502 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479aa0-f771-4f5b-a071-8c5c06e313b4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:38.116945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ed493-5974-44e6-be19-72190c28b827 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:38.154972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f2ea2-58af-4499-a555-87209bd2eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:38.155638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f2ea2-58af-4499-a555-87209bd2eed1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.155915 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f2ea2-58af-4499-a555-87209bd2eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.156192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f2ea2-58af-4499-a555-87209bd2eed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.162552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:38.163243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.163562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.164031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.165180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:38.165482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:38.166884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:38.178292 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 169/344] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:38.179399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.248628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f2ea2-58af-4499-a555-87209bd2eed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:38.248628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f2ea2-58af-4499-a555-87209bd2eed1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:38.252816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.318452 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74afa1d-82b4-4b46-80e9-4faeb4b9bf5b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:38.331566 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.378793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:38.382012 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.382529 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.383029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.398905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 176/345] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:38.405338 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3329b-09a3-4cd9-843e-794b4cbc9c22 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.405915 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3329b-09a3-4cd9-843e-794b4cbc9c22 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.406708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:38.408303 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3329b-09a3-4cd9-843e-794b4cbc9c22 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.410810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 177/346] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:38.411864 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3329b-09a3-4cd9-843e-794b4cbc9c22 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:38.419667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:38.420728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:49:38.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:38.422338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 170/347] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:38.423864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.555429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3329b-09a3-4cd9-843e-794b4cbc9c22 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:38.562445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7d75-650d-48d6-8b44-60324a8c033d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:38.585108 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.603114 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:38.603770 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.604044 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.604312 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.616839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd912902-540c-43dc-bf0c-0678117f6ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:38.618387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd912902-540c-43dc-bf0c-0678117f6ad1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.619153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd912902-540c-43dc-bf0c-0678117f6ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.619637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd912902-540c-43dc-bf0c-0678117f6ad1 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.621103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd912902-540c-43dc-bf0c-0678117f6ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:38.622974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd912902-540c-43dc-bf0c-0678117f6ad1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:38.626124 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 171/348] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:38 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:38.627813 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.628295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.633190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.640342 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.655736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:38.657794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:38.693419 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:38.695769 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:38.749829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 172/349] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:38.751183 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.837150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 178/350] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:38.839716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.880481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df40bfd-29a9-40ab-9992-e98ac6cdabac None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:38.899865 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.910896 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:38.937500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:38.938250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:38.938616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:38.938829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:38.939754 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:38.939906 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:38.942877 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:38.953905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 173/351] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:38.954770 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:38.971037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358582-cbbe-4597-ab9f-d4400e179b8e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.021070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.021962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.022233 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.022532 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.032356 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.033884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.035671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 179/352] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:38 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.036445 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.111479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9481a-310c-435f-ad03-89088d3833ce None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.159541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83661-8b5b-440a-9eab-0cfa9638554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.160786 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83661-8b5b-440a-9eab-0cfa9638554c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.161362 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83661-8b5b-440a-9eab-0cfa9638554c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.161840 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83661-8b5b-440a-9eab-0cfa9638554c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.176508 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83661-8b5b-440a-9eab-0cfa9638554c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-1cb83661-8b5b-440a-9eab-0cfa9638554c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:39.188081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:39.189157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:39.189985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 174/353] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:39.191497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23982-bcb2-4db8-b461-e89456542d30 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.191497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23982-bcb2-4db8-b461-e89456542d30 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.191497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23982-bcb2-4db8-b461-e89456542d30 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.195445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 175/354] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:39.195445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23982-bcb2-4db8-b461-e89456542d30 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.207094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728964-1515-4661-8a5d-60d3372b83f2 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.243295 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:39.258060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.258219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.259233 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.259233 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.260921 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:39.261347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.263635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.265991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 180/355] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.266978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.349361 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23982-bcb2-4db8-b461-e89456542d30 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.411512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823c0e-48ba-4899-9bae-68ef4bcc299c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.413487 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.415094 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.415491 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.416793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] PATH_INFO: `/v3/users/386b588d45a7473591286360effab99b` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.422704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] RBAC: Authorizing `identity:get_user(user_id=386b588d45a7473591286360effab99b)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.424747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.427536 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 176/356] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/users/386b588d45a7473591286360effab99b => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.428109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.457582 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.458541 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.458967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.459375 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.460840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:39.460840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.462170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337b5a-4df7-4efe-916d-cf74640a91b2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.469687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 181/357] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.471033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.471308 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.471591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.499167 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:39.502094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:39.585130 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:39.594837 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfa30c-da30-4af8-8c26-49b45a7d7626 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.598862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:39.614262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 182/358] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:39.615554 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.649465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.651023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.651510 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.652006 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.653049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:39.653608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.655683 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.670455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 177/359] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.671660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.769868 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1282-7e6f-4ee0-9a9e-8ab162ef26a2 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.816965 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4784c3-e18e-4ad3-99ed-dbdc5a689e04 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:39.823975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.825209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.825323 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.825522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.826974 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.828560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.831200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 183/360] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.832025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.870694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:39.871820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:39.871947 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:39.872152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:39.873565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] RBAC: Adding query filter params (role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8, user.id=386b588d45a7473591286360effab99b, scope.system=all) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:39.873676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:39.875130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:39.892305 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 178/361] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/role_assignments?user.id=386b588d45a7473591286360effab99b&scope.system=all&role.id=53e9f4ea3ffc4421ba7eda1d180f6fa8 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:39.901915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:39.915740 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:39.948297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:39.999097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fe12b-af53-4845-84bb-254ddc60b60d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.051417 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96440a-9e72-4ab8-9ed0-61e55a618f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.052547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96440a-9e72-4ab8-9ed0-61e55a618f5c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.054778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96440a-9e72-4ab8-9ed0-61e55a618f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.054778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96440a-9e72-4ab8-9ed0-61e55a618f5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.056999 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c85e-cf18-4f68-ae9a-d897245ff4de None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.074501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96440a-9e72-4ab8-9ed0-61e55a618f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ab96440a-9e72-4ab8-9ed0-61e55a618f5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:40.086948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:40.087909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:40.088772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:40.091331 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 184/362] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:40.093061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d2e63-81e2-4d8d-8d30-6c3abaace35a None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.093569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d2e63-81e2-4d8d-8d30-6c3abaace35a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.094040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d2e63-81e2-4d8d-8d30-6c3abaace35a None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.095966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 185/363] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:40.097033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d2e63-81e2-4d8d-8d30-6c3abaace35a None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:40.109208 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.109875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.110718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.111003 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.207323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:40.208741 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:40.231156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d2e63-81e2-4d8d-8d30-6c3abaace35a None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.251666 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:40.255269 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:40.284154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.284873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.285143 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.285444 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.286321 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:40.286653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:40.288525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb0db8-f2a7-471d-a3d8-681d8ecfc5e0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:40.298509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 186/364] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=286215d5d755461885cd022a8d6d411a => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:40.300224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.300651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.301036 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.324866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:40.326855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:40.356145 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 179/365] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:40.357684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:40.437230 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 187/366] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:40.437918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:40.545595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9ef8-86ba-4f99-9b3b-feb3ec86fd34 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.584327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684bdca-b206-40f9-aab0-a9fee92f40d3 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.588044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:40.593477 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:40.607355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.608158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.608438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.608748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.609512 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:40.609817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:40.611211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:40.620384 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 180/367] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:40.621082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:40.644814 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.645701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.645977 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.646247 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.647560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:40.649204 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:40.651493 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 188/368] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:40.652270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:40.731772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1a1c0-1caf-46c2-a7cf-ab117ce7b2e4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.769954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a1c4-b222-486f-a53d-f2b5873a5834 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.775158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.776245 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.776770 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.777240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.790137 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:40.798838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:40.799728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:40.800557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:40.805915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 181/369] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:40.807270 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:40.811337 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.812016 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.812292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.812562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.861906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:40.865037 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:40.895859 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:40.897627 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:40.927557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea9f34-ca47-42cf-979e-20c2a0fec01f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:40.964175 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:40.965286 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:40.965911 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:40.966288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:40.968369 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:40.970598 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:40.973024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 182/370] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:40.974279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.020745 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 189/371] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:41.023716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.110183 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390115-2150-4722-acc8-8dba057a5d0c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.117228 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:41.132061 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:41.151451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f2a2-1b53-4803-8877-a6a9f6b5c1f8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.158920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:41.159682 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:41.160034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:41.160761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:41.163395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:41.164005 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:41.165811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:41.175471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 183/372] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:41.176102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.193765 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:41.194869 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:41.195349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:41.195883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:41.196947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=459a4644fae64ed29b84d1098c8934d1) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:41.197491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:41.199390 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:41.206055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 190/373] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:41.207292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.331530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0e740-f984-4e8a-b3ae-5f50ebc1c84c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.372899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:41.373574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:41.373856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:41.374133 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:41.382807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7c28c-2c7d-4ee0-9587-93b2b52e46b2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.383927 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:41.462125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:41.464024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:41.464717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:41.465642 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:41.465919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:41.466214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:41.472538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:41.474537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:41.477129 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 184/374] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:41.501684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.586378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 191/375] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:41.598126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.603196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:41.676007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:41.708893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad4af7-1fa5-4883-a176-47a3ce0f16d1 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.759877 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:41.761197 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:41.761482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:41.761759 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:41.762992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:41.765267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:41.772435 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 185/376] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:41.774647 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.831028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d732ae-ba2a-476f-a5c8-e7666420d6da None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.906775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:41.907715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:41.907951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:41.908224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] PATH_INFO: `/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:41.909473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] RBAC: Authorizing `identity:get_project(project_id=d9e6ecd9bce64bb4817795f5da7ca976)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:41.912391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:41.918014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 192/377] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976 => generated 344 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:41.924887 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:41.937502 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5de4f-8237-4397-9d33-6e8d35e5118b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:41.965182 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:42.013680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:42.014448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.014730 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.015008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.017699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=459a4644fae64ed29b84d1098c8934d1) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:42.018023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:42.019523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:42.035095 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 186/378] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=286215d5d755461885cd022a8d6d411a => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:42.089434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9af8b2-8f95-41bd-8c13-593eb5d0473e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:42.101768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:42.138183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf064374-43fd-4a52-b0f0-4010a3ea4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:42.139504 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064374-43fd-4a52-b0f0-4010a3ea4fbc None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.139978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064374-43fd-4a52-b0f0-4010a3ea4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.140451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064374-43fd-4a52-b0f0-4010a3ea4fbc None admin] PATH_INFO: `/v3/groups/d773b320c0054295bac5111f1920bc0f` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.150084 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf064374-43fd-4a52-b0f0-4010a3ea4fbc None admin] RBAC: Authorizing `identity:get_group(group_id=d773b320c0054295bac5111f1920bc0f)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:42.151917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf064374-43fd-4a52-b0f0-4010a3ea4fbc None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:42.154261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 193/379] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:41 2022] GET /identity/v3/groups/d773b320c0054295bac5111f1920bc0f => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:42.160151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:42.171376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321942-38f5-4cb2-a2e2-8980bf5019aa None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.172019 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321942-38f5-4cb2-a2e2-8980bf5019aa None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.172495 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321942-38f5-4cb2-a2e2-8980bf5019aa None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.174282 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 194/380] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:42.185691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.186527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.186977 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.221391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:42.222559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:42.340062 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 195/381] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:42.390640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4422ae-3f93-4381-83ab-51f75b6ad04b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:42.395232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:42.446291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:42.447393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.447871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.448339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.449429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] RBAC: Adding query filter params (group.id=d773b320c0054295bac5111f1920bc0f, role.id=d384469b72f5485190c772f8974438e0, scope.project.id=d9e6ecd9bce64bb4817795f5da7ca976) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:42.449957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:42.451680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:42.459050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 187/382] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:42 2022] GET /identity/v3/role_assignments?group.id=d773b320c0054295bac5111f1920bc0f&scope.project.id=d9e6ecd9bce64bb4817795f5da7ca976&role.id=d384469b72f5485190c772f8974438e0 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:42.515682 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:42.519829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d805-7700-48ea-a70f-4397fde8b777 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:42.570595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:42.571455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.571739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.572009 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.585640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:42.593988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:42.595573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:42.596759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 196/383] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:42.601834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:42.687575 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:42.769540 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4599-5290-43ae-9625-8613b9b9faf2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:42.808675 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:42.809458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:42.809686 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:42.810006 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:42.810797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:42.811113 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:42.812575 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:42.822838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 188/384] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:42.828716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:42.957451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6d114-4fac-4c66-b52a-630127c26e0f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:42.999430 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:43.000333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.000646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.000899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.002101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:43.003563 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:43.005411 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 197/385] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:42 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:43.011240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:43.129549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e6245-6c60-4d29-9c23-00809d056a64 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:43.131005 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:43.178075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40a412-a2d7-4137-a8a0-2c2a446e9764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:43.178968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a412-a2d7-4137-a8a0-2c2a446e9764 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.179244 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a412-a2d7-4137-a8a0-2c2a446e9764 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.179512 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a412-a2d7-4137-a8a0-2c2a446e9764 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.180782 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40a412-a2d7-4137-a8a0-2c2a446e9764 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:43.182235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40a412-a2d7-4137-a8a0-2c2a446e9764 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:43.184322 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 189/386] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:43 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:43.190127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:43.229099 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:43.321577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ae5f-541c-4f0d-8830-147c5147813d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:43.363451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c60a4-b8ee-42ed-9e7b-43f7afe2e59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:43.364729 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c60a4-b8ee-42ed-9e7b-43f7afe2e59a None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.365215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c60a4-b8ee-42ed-9e7b-43f7afe2e59a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.365685 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c60a4-b8ee-42ed-9e7b-43f7afe2e59a None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.368985 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c60a4-b8ee-42ed-9e7b-43f7afe2e59a None admin] RBAC: Authorizing `identity:create_grant(project_id=d32704e1694041efbe1cdb94f6ff9aa8, group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:43.370719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c60a4-b8ee-42ed-9e7b-43f7afe2e59a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:43.396449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 198/387] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jul 23 20:49:43 2022] PUT /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:43.429533 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a055-18c8-46fe-b421-dde0993fdf83 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.429866 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a055-18c8-46fe-b421-dde0993fdf83 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.430079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a055-18c8-46fe-b421-dde0993fdf83 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.431914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 190/388] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:43.437494 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.438063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.438539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.465881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:43.467570 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:43.556557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 199/389] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:43.588950 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a055-18c8-46fe-b421-dde0993fdf83 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:43.740680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a055-18c8-46fe-b421-dde0993fdf83 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:43.780679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:43.781574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.781901 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.782177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.793832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:43.802186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:43.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:43.803867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 191/390] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:43.809517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:43.833209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:43.936809 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd73b1c-55a5-4e56-8b1e-c1b0d7b117ae None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:43.976415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:43.977141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:43.977420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:43.977688 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:43.978498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:43.978802 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:43.980210 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:43.997671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 200/391] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:44.003708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:44.054346 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:44.148671 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8d38-9cd5-4bec-9043-dbe63dd009cb None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:44.200954 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7e99-b3a9-4257-affb-c8e30cf7d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:44.201901 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7e99-b3a9-4257-affb-c8e30cf7d142 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.202187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7e99-b3a9-4257-affb-c8e30cf7d142 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.202465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7e99-b3a9-4257-affb-c8e30cf7d142 None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.209318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7e99-b3a9-4257-affb-c8e30cf7d142 None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:44.210795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7e99-b3a9-4257-affb-c8e30cf7d142 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:44.212476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 192/392] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:44 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:44.218529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:44.284295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61fcd-a35b-41a9-91b3-2e756f61cf1e None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.284680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61fcd-a35b-41a9-91b3-2e756f61cf1e None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.284882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61fcd-a35b-41a9-91b3-2e756f61cf1e None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.288750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 193/393] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:44.294265 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.294555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.294839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.337791 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:44.339232 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:44.345074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:44.375802 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9925d-4406-4fa3-9543-d2fa6236b42d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:44.425472 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:44.426380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.426665 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.426941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.428262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:44.429770 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:44.431841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 201/394] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:44 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:44.437567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:44.440857 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 194/395] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:44.460049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:44.488957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:44.565779 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2d72-e23d-432f-9914-5d5ebff1231e None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:44.602139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:44.602982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.603240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.603515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.614564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:44.622267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:44.623277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:44.624073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:44.630995 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 195/396] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:44.632757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:44.653315 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e30be-f4a1-4cdf-82ca-0b3ab96409cf None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:44.719046 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:44.719950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.720232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.720513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/286215d5d755461885cd022a8d6d411a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.726388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32704e1694041efbe1cdb94f6ff9aa8, group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role_id=286215d5d755461885cd022a8d6d411a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:44.727857 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:44.756164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 202/397] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jul 23 20:49:44 2022] PUT /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/286215d5d755461885cd022a8d6d411a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:49:44.782658 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:44.796864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33827675-ad15-488b-9251-52b5e7c0f017 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:44.833972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:44.834584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:44.834867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:44.835149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:44.835970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:44.836283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:44.837884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:44.852526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 196/398] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:44.854183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:44.874172 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:45.020524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f123b-87f9-4e60-9df9-ed8583786877 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:45.067848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b9b3c-63fa-4591-ba94-f1dc4b6b730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:45.068804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b9b3c-63fa-4591-ba94-f1dc4b6b730b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.069087 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b9b3c-63fa-4591-ba94-f1dc4b6b730b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.069363 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b9b3c-63fa-4591-ba94-f1dc4b6b730b None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.070776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b9b3c-63fa-4591-ba94-f1dc4b6b730b None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:45.072317 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b9b3c-63fa-4591-ba94-f1dc4b6b730b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:45.074658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 203/399] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:44 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:45.081976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.156695 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4d14-d371-451a-9ea5-c3ffad1c7e20 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.156882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4d14-d371-451a-9ea5-c3ffad1c7e20 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.157110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4d14-d371-451a-9ea5-c3ffad1c7e20 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.159062 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 204/400] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:45.168164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.168506 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.168812 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.191123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:45.192351 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:45.276439 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 205/401] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:45.294878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db025a-8881-4597-9e2f-e01a67d55e68 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:45.311060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.325007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:45.369925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:45.371246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.371718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.372282 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.377213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:45.379046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:45.381798 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 197/402] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:45 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:45.387515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.428924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:45.436047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330076a7-c02c-4159-b248-d7395faee0c8 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:45.478499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:45.479414 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.479744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.482799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.494702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:45.504403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:45.505379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:45.506147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 206/403] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:49:45.518318 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.595365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:45.626899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f75f8-6ecd-4b8a-b52b-ec380224fe39 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:45.650808 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b36995-5d05-4cb7-940a-75a547c66a87 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:45.662113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:45.663132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.663132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.663394 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.664080 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:45.664783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:45.666199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:45.675184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 207/404] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:45.680386 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.745432 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d129217-e297-4c2b-a50c-3f2558ce6e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:45.746717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d129217-e297-4c2b-a50c-3f2558ce6e0b None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.747115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d129217-e297-4c2b-a50c-3f2558ce6e0b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.747486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d129217-e297-4c2b-a50c-3f2558ce6e0b None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.749766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d129217-e297-4c2b-a50c-3f2558ce6e0b None admin] RBAC: Authorizing `identity:create_grant(project_id=459a4644fae64ed29b84d1098c8934d1, group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:45.751319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d129217-e297-4c2b-a50c-3f2558ce6e0b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:45.769331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 198/405] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jul 23 20:49:45 2022] PUT /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:49:45.770989 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207dee9-21e9-4ed5-8d0f-6ab323ba7ff6 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.771402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207dee9-21e9-4ed5-8d0f-6ab323ba7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.771776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207dee9-21e9-4ed5-8d0f-6ab323ba7ff6 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.773547 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 199/406] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:45.779676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.780121 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.780566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.801385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:45.802951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:45.806486 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbac63-4bde-481e-a0ce-b95b94862b75 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:45.850107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:45.859950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:45.861029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:45.861404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:45.861778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:45.863174 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:45.864946 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:45.867335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 208/407] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:45 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:45.877713 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.902299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 200/408] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:45.927972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:45.939951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:46.023953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9b28-285a-400f-a546-e370524930e8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.062268 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.063167 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.063449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.063727 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.065092 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:46.066605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:46.068938 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 209/409] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:45 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:46.074519 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:46.127021 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506a1cc-6894-4e87-9203-717ffee7056b None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.153733 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:46.168644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.169593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.169880 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.170200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.183964 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:46.192439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:46.194402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:46.195849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 201/410] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:46.205371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:46.205691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096638a8-1954-4a18-ac29-090f4a90eadb None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.247854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.254147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.254632 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.255086 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/286215d5d755461885cd022a8d6d411a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.257936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] RBAC: Authorizing `identity:create_grant(project_id=459a4644fae64ed29b84d1098c8934d1, group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role_id=286215d5d755461885cd022a8d6d411a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:46.259610 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:46.282336 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:46.288824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 210/411] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jul 23 20:49:46 2022] PUT /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb/roles/286215d5d755461885cd022a8d6d411a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:46.328480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb845a9-25ea-426e-93d2-7e1956ad445e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.367910 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.368886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.369346 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.369759 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.370666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:46.371121 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:46.372708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2c95e-6191-4b0e-8f5f-33783c220d69 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:46.384168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 202/412] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:46.390348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:46.482654 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc654c-5f0a-4efe-8c07-c10c08b37023 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.482912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc654c-5f0a-4efe-8c07-c10c08b37023 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.483473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc654c-5f0a-4efe-8c07-c10c08b37023 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.485149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 203/413] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:46.503384 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.503760 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.503969 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.525324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075c93a-fb13-4ca1-8062-3e0ed375e274 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.552433 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:46.554532 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:46.556120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:46.575387 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.576353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.576657 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.576938 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] PATH_INFO: `/v3/groups/d773b320c0054295bac5111f1920bc0f` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.580678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] RBAC: Authorizing `identity:get_group(group_id=d773b320c0054295bac5111f1920bc0f)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:46.582235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:46.586509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 211/414] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:46 2022] GET /identity/v3/groups/d773b320c0054295bac5111f1920bc0f => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:46.591449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:46.683862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 204/415] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:46.717809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:46.747262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5e7b5-1ada-4811-bef2-e1c3a32ae024 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.818753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.820026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.820473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.820960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] PATH_INFO: `/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:46.823021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] RBAC: Authorizing `identity:get_project(project_id=d9e6ecd9bce64bb4817795f5da7ca976)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:46.832439 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:46.836217 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 212/416] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:46 2022] GET /identity/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976 => generated 344 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:46.842920 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:46.877014 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:46.929760 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb747-6368-4d92-b1e7-4b56cb8163c0 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:46.983538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:46.984445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:46.984765 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:46.985083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.004631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:47.008579 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:47.020425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:47.022077 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:47.022940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:47.026972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 205/417] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:47.044248 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:47.083759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e5789-784a-4bfb-a648-25588c6e7926 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:47.167156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:47.168248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:47.168536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:47.169020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] PATH_INFO: `/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976/groups/d773b320c0054295bac5111f1920bc0f/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.171550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] RBAC: Authorizing `identity:create_grant(project_id=d9e6ecd9bce64bb4817795f5da7ca976, group_id=d773b320c0054295bac5111f1920bc0f, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:47.173589 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:47.191872 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a26cd-52f0-4086-8941-6bd0f89e1cbe None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:47.200522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 213/418] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jul 23 20:49:46 2022] PUT /identity/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976/groups/d773b320c0054295bac5111f1920bc0f/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:49:47.236591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:47.277527 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:47.278320 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:47.278700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:47.279100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.280016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] RBAC: Adding query filter params (name=member) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:47.280390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:47.282086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0aa23-f9b1-43b0-a12c-b7e03e521818 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:47.301020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 206/419] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:47.307631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:47.468555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cfc8a-017c-4610-8cb2-5dc9db28b06a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:47.495899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:47.517693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:47.518393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:47.518674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:47.518990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.602543 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:47.604041 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:47.680345 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1d24-a5bc-4afd-88e8-8ac243f2c4e9 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:47.680723 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1d24-a5bc-4afd-88e8-8ac243f2c4e9 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:47.681146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1d24-a5bc-4afd-88e8-8ac243f2c4e9 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.683408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 207/420] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:47.690306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:47.690718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:47.691120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.721273 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 214/421] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:47.722733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:47.724224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:47.733160 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:47.770796 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:47.874431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9e27-c6c8-47f8-8b44-b476b4659e49 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:47.920628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 208/422] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:47.966511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:47.967895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:47.968400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:47.968907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:47.973595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:47.975712 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:47.978065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 215/423] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:47 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:47.983998 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:47.985200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:48.165089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:48.191881 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7ff2-4a7c-40ea-94aa-6472db08ea6a None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:48.208316 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f990f4a-6d27-44bc-9cd9-9173899d4016 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:48.214947 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:48.253346 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:48.260637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:48.260637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:48.260637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:48.260637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:48.261532 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:48.265274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 209/424] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:47 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:48.269426 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:48.294978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:48.295840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:48.296129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:48.296410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:48.311150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:48.321124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:48.322075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:48.322893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 216/425] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:48.332272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:48.429566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba551e-0a50-412a-8ac8-8a7595ccad75 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:48.478526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:48.479196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:48.479467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:48.479736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:48.480883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:48.481572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:48.483142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:48.497128 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 210/426] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:48 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:48.547377 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7ee8-86df-4780-a7b1-94bd83821715 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:48.583571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:48.584250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:48.584530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:48.584833 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:48.585579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:48.585880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:48.587269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:48.596315 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 217/427] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:48.602172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:48.654663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:48.717278 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e09799-78ed-4c5d-ab51-fa923efe48b0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:48.752197 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ccb0-b3c7-4a2f-b235-212739deaf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:48.753245 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ccb0-b3c7-4a2f-b235-212739deaf3b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:48.753695 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ccb0-b3c7-4a2f-b235-212739deaf3b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:48.754131 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ccb0-b3c7-4a2f-b235-212739deaf3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:48.826031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5ccb0-b3c7-4a2f-b235-212739deaf3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:48.827882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5ccb0-b3c7-4a2f-b235-212739deaf3b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:48.873647 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:48.932134 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 211/428] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:49:48.938298 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:48.952467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:49.069611 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfadc1-6a0f-4b88-b8c9-88bf75565584 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.113371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85004-6996-49b5-a4b7-499040538335 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.114126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85004-6996-49b5-a4b7-499040538335 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.116973 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85004-6996-49b5-a4b7-499040538335 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.119368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 212/429] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:49.119497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:49.120423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.120697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.120978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] PATH_INFO: `/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.123548 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] RBAC: Authorizing `identity:get_project(project_id=d32704e1694041efbe1cdb94f6ff9aa8)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:49.129687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:49.129687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 218/430] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:48 2022] GET /identity/v3/projects/d32704e1694041efbe1cdb94f6ff9aa8 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:49:49.132002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fa1d8-5215-4397-8d7c-a295ceed7df7 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.132352 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fa1d8-5215-4397-8d7c-a295ceed7df7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.133653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fa1d8-5215-4397-8d7c-a295ceed7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.138096 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.160784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-600fa1d8-5215-4397-8d7c-a295ceed7df7 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:49.162352 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-600fa1d8-5215-4397-8d7c-a295ceed7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:49.259831 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 213/431] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:49.262569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:49.266380 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec9cc-c57b-45cb-8441-847f7937fcc3 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.266742 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec9cc-c57b-45cb-8441-847f7937fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.267028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec9cc-c57b-45cb-8441-847f7937fcc3 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.272626 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 214/432] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:49.275332 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.275824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.276286 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.292385 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb8e8-7d4d-409d-8d93-d5ded161233b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.298888 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:49.300572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:49.339317 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:49.340560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.341082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.341553 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.343027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:49.344764 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:49.346644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 219/433] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:49.347708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.393136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 215/434] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:49.394151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.407825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:49.475125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3581e2-6fbf-40d7-b0d9-cc0e4ff0347f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.515529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:49.516486 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.516773 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.517068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.529264 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:49.537539 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819386fb-c1fd-485c-a904-59b51c3717a3 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:49.538248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:49.539129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:49:49.540281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:49.545033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 220/435] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:49.546232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.557033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:49.587635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:49.588456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.588838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.589118 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.590051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:49.590376 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:49.592124 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:49.608639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 216/436] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=d32704e1694041efbe1cdb94f6ff9aa8&role.id=286215d5d755461885cd022a8d6d411a => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:49.608639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.703687 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:49.718248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223733e-455f-481f-ac1f-b351b2749e32 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.761970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:49.762900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.763306 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.763571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.767533 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ac9c-cb5c-4944-9c3a-e8b79c97d05e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.779133 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:49.789021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:49.790517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:49.791536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 221/437] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:49.799179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.812156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:49.812891 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:49.813172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:49.813439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:49.814200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:49.814500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:49.817142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:49.829653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 217/438] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:49.838279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:49.917022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:49.972260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453f8c5-7923-41c5-9a78-b00743ab5ff0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:49.997653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2effe-ebe6-44e8-ab3f-5422d0aef71b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.014779 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.015460 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.015732 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.016320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.017109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] RBAC: Adding query filter params (name=member) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:50.017413 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.018938 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.029001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 222/439] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:50.035961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.046665 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.054677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d46a-8cd4-4802-a562-75ac993c2262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.055994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d46a-8cd4-4802-a562-75ac993c2262 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.056730 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d46a-8cd4-4802-a562-75ac993c2262 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.057372 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d46a-8cd4-4802-a562-75ac993c2262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.160809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d46a-8cd4-4802-a562-75ac993c2262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.162857 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d46a-8cd4-4802-a562-75ac993c2262 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.176189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c134fe5-928f-4fe9-80f2-e55f12788513 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.208856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.217866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78908a2a-87f4-42c5-a60f-5cc0c0bd1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.218590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78908a2a-87f4-42c5-a60f-5cc0c0bd1036 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.218901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78908a2a-87f4-42c5-a60f-5cc0c0bd1036 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.219202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78908a2a-87f4-42c5-a60f-5cc0c0bd1036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.297684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 218/440] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:49:50.297684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c0f4-1b1d-4295-9185-8be16a6b81c4 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.297684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c0f4-1b1d-4295-9185-8be16a6b81c4 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.297684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c0f4-1b1d-4295-9185-8be16a6b81c4 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.297684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 219/441] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:50.298139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78908a2a-87f4-42c5-a60f-5cc0c0bd1036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.298659 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15c0f4-1b1d-4295-9185-8be16a6b81c4 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.299715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78908a2a-87f4-42c5-a60f-5cc0c0bd1036 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.335959 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.417906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 223/442] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:49:50.424304 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15c0f4-1b1d-4295-9185-8be16a6b81c4 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.424446 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.424446 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.424446 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.441968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:50.443383 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:50.456769 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.458035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.458396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.458710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.460138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.462268 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.464545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 220/443] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:50.465220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.470213 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.518297 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 224/444] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:50.519200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.572844 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.577557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d9f55-07e8-4505-a107-fa585c4e9ef6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.618975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.619873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.620238 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.620667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] PATH_INFO: `/v3/projects/459a4644fae64ed29b84d1098c8934d1` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.622050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] RBAC: Authorizing `identity:get_project(project_id=459a4644fae64ed29b84d1098c8934d1)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.624263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.626338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 221/445] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/projects/459a4644fae64ed29b84d1098c8934d1 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:50.626904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.645152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bda8b-cace-4bdd-8ae8-8f7edd3e35d9 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.684287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.685241 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.685645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.685953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.687209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.688848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.690982 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 225/446] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:50.691607 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.721815 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.742398 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16dee3-4a53-4b9d-ab04-218a13310673 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.779691 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.780572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.780913 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.781177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.793830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:50.802075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:50.802972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:49:50.803854 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:50.805008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 222/447] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:50.805829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e7bd-c987-4bbf-a4f0-458bf6b5e878 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.806004 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.840575 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.854429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.855294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.855566 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.855833 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] PATH_INFO: `/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.857049 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] RBAC: Authorizing `identity:get_group(group_id=b3d6cb979dd34e9cabcc9b7a9f6b39eb)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.858662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.860315 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 226/448] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/groups/b3d6cb979dd34e9cabcc9b7a9f6b39eb => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:50.861101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.928249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0340f1-e03a-45be-b7dd-850b4a24098c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:50.963986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:50.964678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:50.964964 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:50.965240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:50.966071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=286215d5d755461885cd022a8d6d411a, scope.project.id=459a4644fae64ed29b84d1098c8934d1) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:50.966383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:50.967845 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:50.974198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 223/449] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=286215d5d755461885cd022a8d6d411a => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:50.974939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:50.976623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:50.986196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5764d2-72dc-485a-903b-18e66b78ade3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:51.028454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:51.029217 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:51.029502 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:51.029795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:51.030652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:51.030972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:51.032485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:51.045528 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 227/450] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:51.051728 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:51.108272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:51.120626 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe91a6-4987-4a70-9f47-f92ed953551d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:51.168844 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:51.169571 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:51.169886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:51.170224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:51.171146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] RBAC: Adding query filter params (group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb, role.id=87f72d0ef80748d3944fa5d7e9d022a0, scope.project.id=459a4644fae64ed29b84d1098c8934d1) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:51.171467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:51.173059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:51.179667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 224/451] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:50 2022] GET /identity/v3/role_assignments?group.id=b3d6cb979dd34e9cabcc9b7a9f6b39eb&scope.project.id=459a4644fae64ed29b84d1098c8934d1&role.id=87f72d0ef80748d3944fa5d7e9d022a0 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:51.183829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8989-6c4c-45b5-b0bb-e7c1e8a2fe65 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:51.245759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:51.246331 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:51.246608 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:51.246875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:51.288760 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:51.341223 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:51.342821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:51.455816 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 228/452] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:49:51.462107 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:51.571519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44eea3-4020-4f03-9266-7df5b2775ec1 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:51.606563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:51.607653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:51.608016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:51.608295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] PATH_INFO: `/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:51.609562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] RBAC: Authorizing `identity:get_project(project_id=d9e6ecd9bce64bb4817795f5da7ca976)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:51.611035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:51.612789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 225/453] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jul 23 20:49:51 2022] GET /identity/v3/projects/d9e6ecd9bce64bb4817795f5da7ca976 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:51.618758 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:51.682090 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:51.731286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62494c07-e99c-4242-aba7-ee5fbb3ddc44 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:51.765778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0563f1-c425-4242-8102-5006cb604b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:51.766635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0563f1-c425-4242-8102-5006cb604b0d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:51.766909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0563f1-c425-4242-8102-5006cb604b0d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:51.767176 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0563f1-c425-4242-8102-5006cb604b0d None admin] PATH_INFO: `/v3/groups/d773b320c0054295bac5111f1920bc0f` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:51.768355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0563f1-c425-4242-8102-5006cb604b0d None admin] RBAC: Authorizing `identity:get_group(group_id=d773b320c0054295bac5111f1920bc0f)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:51.769819 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0563f1-c425-4242-8102-5006cb604b0d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:51.771460 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 229/454] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jul 23 20:49:51 2022] GET /identity/v3/groups/d773b320c0054295bac5111f1920bc0f => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:51.777805 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:51.809590 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:51.890942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734e4c-e2c8-495a-a574-7ce97d2ece6e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:51.926371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:51.927019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:51.927302 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:51.927577 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:51.928394 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] RBAC: Adding query filter params (group.id=d773b320c0054295bac5111f1920bc0f, role.id=d384469b72f5485190c772f8974438e0, scope.project.id=d9e6ecd9bce64bb4817795f5da7ca976) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:51.928814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:51.930285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4b1d-6018-4375-b31d-27b82eab2021 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:51.936106 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 226/455] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jul 23 20:49:51 2022] GET /identity/v3/role_assignments?group.id=d773b320c0054295bac5111f1920bc0f&scope.project.id=d9e6ecd9bce64bb4817795f5da7ca976&role.id=d384469b72f5485190c772f8974438e0 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:54.540957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa7ac-7b35-4794-9f2c-6830bfd3fe86 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.542010 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa7ac-7b35-4794-9f2c-6830bfd3fe86 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.542497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa7ac-7b35-4794-9f2c-6830bfd3fe86 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.544465 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 230/456] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:54.550385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd10b-1f64-4d36-bece-d48a0839a67d None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.551261 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd10b-1f64-4d36-bece-d48a0839a67d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.551735 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd10b-1f64-4d36-bece-d48a0839a67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.569418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-137cd10b-1f64-4d36-bece-d48a0839a67d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:54.571046 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-137cd10b-1f64-4d36-bece-d48a0839a67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:54.644306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 227/457] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:54.671900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa7ac-7b35-4794-9f2c-6830bfd3fe86 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:54.747333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb04ff5-dfff-4015-854d-6cfa774abde0 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.748019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb04ff5-dfff-4015-854d-6cfa774abde0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.748537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb04ff5-dfff-4015-854d-6cfa774abde0 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.750488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 228/458] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:54.756485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c6bf-023b-4f79-a0dd-559d53d11f21 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.757139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c6bf-023b-4f79-a0dd-559d53d11f21 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.757609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c6bf-023b-4f79-a0dd-559d53d11f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.775832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-fda6c6bf-023b-4f79-a0dd-559d53d11f21 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:54.777516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-fda6c6bf-023b-4f79-a0dd-559d53d11f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:54.790720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:54.792410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa7ac-7b35-4794-9f2c-6830bfd3fe86 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:54.819020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:54.830204 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:54.831042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.831327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.831603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.843097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:54.844748 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:54.860648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 229/459] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:54.866447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:54.867354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:54.868178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:54.868178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:54.868178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:54.868178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:54.868396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98223-b673-4e70-b171-542818a871c0 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.874710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98223-b673-4e70-b171-542818a871c0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.874710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98223-b673-4e70-b171-542818a871c0 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.874942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 231/460] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:54.874942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:54.875467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 230/461] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:54.876971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:54.877552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:54.877829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:54.899965 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:54.901208 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:54.999223 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a790-849e-472a-875a-c00c014c82a7 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.000958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 231/462] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:55.001793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.043038 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.043625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.043908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.044183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.044994 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:55.045298 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.046738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.065462 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 232/463] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:55.066416 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.090049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.108521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.116225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b98e-9141-4fe5-8443-b80451b2db49 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.156101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.156976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.157259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.157536 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.169228 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.170748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.180818 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720d0b-3280-406f-a2fa-f0f2f75f39a8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:55.189230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:55.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:55.191071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:55.191071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:55.191071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:55.191071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:55.191071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:55.191324 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.218898 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.219710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.219988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.220339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.230929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.232438 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-77229b5b-7147-42b4-8817-0ed8deb07dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:55.251469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:55.252498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:55.253526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:55.253526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:55.253526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:55.253526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:55.255590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:55.257030 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51bbc0-57d4-4c40-83a3-8cef7dd5a020 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.257307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51bbc0-57d4-4c40-83a3-8cef7dd5a020 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.257580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51bbc0-57d4-4c40-83a3-8cef7dd5a020 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.258866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 234/466] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:55.259540 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51bbc0-57d4-4c40-83a3-8cef7dd5a020 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.306008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2437cf7-74ad-4122-a827-4c9c54da857f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.337489 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.350672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213431b-8b63-4a8c-81bb-7903b73ff8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.351373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213431b-8b63-4a8c-81bb-7903b73ff8eb None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.351632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213431b-8b63-4a8c-81bb-7903b73ff8eb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.351928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213431b-8b63-4a8c-81bb-7903b73ff8eb None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.352715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213431b-8b63-4a8c-81bb-7903b73ff8eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.354383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213431b-8b63-4a8c-81bb-7903b73ff8eb None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.354915 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.371007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51bbc0-57d4-4c40-83a3-8cef7dd5a020 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.391564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 233/467] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:55 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:55.393063 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.393344 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.393616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.413675 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:55.415307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:55.417962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.418757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.419040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.419347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.420198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:55.420510 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.422065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.437486 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 235/468] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:55.438635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.504397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 234/469] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:55.505437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.562631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843016c4-4483-4161-a6fd-79e7c40b4993 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.602847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.603552 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.603875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.604199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.604908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:55.605207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.606622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.621713 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 236/470] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:55.622554 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.633813 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.658380 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603765-d664-44c5-a40a-d671e6ed3456 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.675749 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.698782 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.699466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.699748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.700022 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.700787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.702536 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.724300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 235/471] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:55 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:55.725233 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.749768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368027c-2424-41b6-8c99-ab9b2e433e12 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.791302 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.792249 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.792737 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.793082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.806427 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.808135 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:55.829164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:55.830063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:55.830892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:55.830892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:55.830892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:55.830892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:55.830892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 237/472] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:55.837089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:55.844959 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190395-81f5-4cd4-9ed9-22ab7c52204f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:55.885103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:55.885927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:55.886213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:55.886490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:55.887217 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:55.888968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:55.908976 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:55.917519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 236/473] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:55 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:55.968169 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a24f-6a7b-4fec-9113-da359e6c31fa None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:56.012177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:56.012904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:56.013188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:56.013706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:56.014291 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:56.014616 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:56.016046 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45639a8-7308-4dca-9ff5-49c3bdf2f3d5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:56.031315 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 238/474] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:56.036903 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:56.069733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:56.149492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e4f9-1aa7-46d2-af3e-0ee7943bcc2d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:56.186562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ee88e-63b4-4c66-b2c0-8af077d9f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:56.187515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee88e-63b4-4c66-b2c0-8af077d9f37e None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:56.187951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee88e-63b4-4c66-b2c0-8af077d9f37e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:56.188361 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee88e-63b4-4c66-b2c0-8af077d9f37e None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:56.189251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ee88e-63b4-4c66-b2c0-8af077d9f37e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:56.190835 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ee88e-63b4-4c66-b2c0-8af077d9f37e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:56.215215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 237/475] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:49:56 2022] POST /identity/v3/users => generated 249 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:49:57.738399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fd61-e149-468f-9834-6c2be286b619 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:57.738937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fd61-e149-468f-9834-6c2be286b619 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:57.738937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fd61-e149-468f-9834-6c2be286b619 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:57.740448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 239/476] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:57.746242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:57.746728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:57.746807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:57.764109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:57.765390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:57.834295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 238/477] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:57.859123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fd61-e149-468f-9834-6c2be286b619 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:57.976435 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fd61-e149-468f-9834-6c2be286b619 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.000698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.021956 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117e962-f8e2-473c-a971-3e92ae56e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.022782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117e962-f8e2-473c-a971-3e92ae56e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.023061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117e962-f8e2-473c-a971-3e92ae56e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.023333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117e962-f8e2-473c-a971-3e92ae56e4a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.035030 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117e962-f8e2-473c-a971-3e92ae56e4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-2117e962-f8e2-473c-a971-3e92ae56e4a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:58.043418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:58.045162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:58.046069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 240/478] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:58.054690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.070817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.152984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3032-f910-4bf3-93cd-e60ad652f7a3 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.153341 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3032-f910-4bf3-93cd-e60ad652f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.153541 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3032-f910-4bf3-93cd-e60ad652f7a3 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.154999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 241/479] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:49:58.160232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.160512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.160825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.166890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375a1c-2944-4588-9d68-6dbf80d0dadd None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.180275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:58.181904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:58.215871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.215871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.215871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.215871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.216311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:58.216311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:58.218000 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:58.235212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 239/480] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:58.239746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.300668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 242/481] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:49:58.322091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.351754 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.391596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b779f6-a454-481b-b460-09676bb31a34 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.433917 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.434915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.435186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.435498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.446789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:58.448255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:58.449955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42344-4e19-4da5-953b-a3de2970d14a None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.461139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-b818cf6e-83e7-4146-bdf7-0c4b31985154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:58.466399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:58.467451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:58.468495 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:58.468495 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:58.468495 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:58.468495 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:58.470069 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 240/482] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:58.471431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c1d5-9a89-46d7-bc1d-4a4aa78f71b1 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.471874 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c1d5-9a89-46d7-bc1d-4a4aa78f71b1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.472286 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c1d5-9a89-46d7-bc1d-4a4aa78f71b1 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.473740 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 241/483] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:58.475554 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c1d5-9a89-46d7-bc1d-4a4aa78f71b1 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.493185 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac690a58-99dc-4ad8-ac88-07bb964a3733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.494024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac690a58-99dc-4ad8-ac88-07bb964a3733 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.494309 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac690a58-99dc-4ad8-ac88-07bb964a3733 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.494579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac690a58-99dc-4ad8-ac88-07bb964a3733 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.506139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac690a58-99dc-4ad8-ac88-07bb964a3733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ac690a58-99dc-4ad8-ac88-07bb964a3733 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:58.513892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:58.514794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 243/484] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:58.516827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.517534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.517534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.533650 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:58.534854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:58.588183 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c1d5-9a89-46d7-bc1d-4a4aa78f71b1 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.603395 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 244/485] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:58.604272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.616001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.626248 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.626919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.627225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.627465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.628545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:58.628882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:58.630268 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c91a-ccec-4d7e-9117-1c0eda666ab9 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:58.642635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 242/486] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:58.644090 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4967a-e04a-49d1-b523-c50e1cad923f None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.644440 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4967a-e04a-49d1-b523-c50e1cad923f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.644805 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4967a-e04a-49d1-b523-c50e1cad923f None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.646105 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 243/487] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:49:58.647275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4967a-e04a-49d1-b523-c50e1cad923f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.712583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.715968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc98c-aea0-4eaa-b0e3-1f4e7c606bf0 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.750186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.750843 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.751124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.751392 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.752112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:58.752438 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:58.753874 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:58.757130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4967a-e04a-49d1-b523-c50e1cad923f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.761955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:58.762742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.793827 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07c9e-ac1b-4e1f-807c-1b704a0b404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.794624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07c9e-ac1b-4e1f-807c-1b704a0b404d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.794958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07c9e-ac1b-4e1f-807c-1b704a0b404d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.795229 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07c9e-ac1b-4e1f-807c-1b704a0b404d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.805357 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc07c9e-ac1b-4e1f-807c-1b704a0b404d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-fbc07c9e-ac1b-4e1f-807c-1b704a0b404d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:58.813093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:58.814165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:58.815109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:58.815893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.816060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.816258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.833215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:49:58.834402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:49:58.864014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716da8b-0fd0-48bd-b43f-bcf1a4c4c996 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:58.879237 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:58.901939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:58.902750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:58.903036 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:58.903291 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:58.904462 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 245/490] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:49:58.905942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.911938 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:58.913427 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:49:58.929884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:58.931026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:49:58.932184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:58.932880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:58.934163 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:58.959460 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.023826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a30ff-4053-4996-b7bf-b8294eb427a3 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.038529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05148-ad77-412c-b646-76fe6f62a1ea None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.063433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.064729 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.065205 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.065672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.074473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.075165 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.075449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.075748 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.076636 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:59.076941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.078431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.082762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.084261 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.087966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:59.088834 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:59.103916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:59.105298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:59.106938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:59.106938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:59.106938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:59.106938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:59.106938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:59.106938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.136010 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.179894 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.196252 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85eced-5c8e-4bc8-b948-1fed0595faf3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.208158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe8693-fe9a-4691-a5cf-8d11b3997414 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.235200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.236293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.236538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.236889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.243434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.244100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.244379 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.244670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.245488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:59.245784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.247237 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.247851 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:49:59.255644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:59.256567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:59.257827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.286863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 247/495] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:59.287729 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.366797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f254-1334-4048-b1a3-cb2d00a7536f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.381742 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.399623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851dd5-b948-4e41-8c8c-f9899b998331 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.404484 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.405501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.405881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.406258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.421447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.422964 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.425981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.438120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.438778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.439067 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.439345 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.440073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:59.440379 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.441828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:59.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:59.443710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:59.444580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:59.444580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:59.444580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:59.444580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:59.444580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 249/496] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:59.445164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.461386 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 248/497] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:59.462180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.557099 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc445e3-e53f-46f4-bd47-d559875f245d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.569033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397efdc-428b-4568-aec6-75b3b8202da9 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.590644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.591333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.591698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.591976 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.592773 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:59.593082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.594503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.603634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.603892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 250/498] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:59.604295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.604575 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.604693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.604882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.622400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.672081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.678891 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.680395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.719312 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20fea-8622-47b4-8eea-855b640813fc None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.762859 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.763637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.763848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.764125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.764890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:49:59.765196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.766643 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.779585 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 251/499] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:49:59.780452 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.789418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 249/500] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:49:59.790300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.841801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.889478 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39240fa-87b4-4356-8b60-4271d0dd373f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.901267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2843c0-0875-4d3a-9727-09b9b536171b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:49:59.909475 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:49:59.927840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.928681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.928963 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.929235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.936620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.938071 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:49:59.939458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:49:59.939735 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:49:59.940000 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:49:59.950050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:49:59.951671 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:49:59.952492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:59.953463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:49:59.954371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 252/501] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:59.955446 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:49:59.974151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:49:59.975114 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:49:59.975945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:49:59.975945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:49:59.975945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:49:59.975945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:49:59.975945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 250/502] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:49:59.976200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.062240 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7d43-4392-490b-8115-67ab540e2a5b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.087107 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.095702 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81328b13-d9b2-4e25-9ae4-6966f1be40eb None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.109393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.110191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.110503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.110770 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.118642 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.120123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.132041 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.132865 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.133148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.133424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:00.135250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:00.136184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:00.137093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:00.138215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.144858 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.146344 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:00.163922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:00.165306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:00.166136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:00.166136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:00.166136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:00.166136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:00.166136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 251/504] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:00.167458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.183615 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.256372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adfff4-0205-49a6-9685-1ae01308516f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.272995 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbc654-ea26-4085-b338-f6f7ad8af742 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.293021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.293707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.293988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.294263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.295129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:00.295441 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.296929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.309655 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.310450 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.310734 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.311016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.311736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:00.312037 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.313466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.326243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 252/505] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:00.327228 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.335417 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 254/506] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:00.336284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.344059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.432867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d593-e38f-4430-8295-c8ed2c49ce4f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.443139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.451210 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d05f-4583-45bc-a659-71c39539e9ad None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.469476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.470156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.470441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.470718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.471560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:00.471871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.473500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.484043 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.484767 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.485049 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.485321 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.486060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:00.486365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.487794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.493542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 253/507] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:00.494437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.501497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 255/508] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:00.502371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.565642 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.601614 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6cd7-b0b3-492c-a698-57c8aba16aa6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.606522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379d98-28f2-4874-b1df-7ce09b3b4513 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.636894 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.637694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.637977 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.638251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.639954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.640638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.640927 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.641202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.646099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.647557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:00.662839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:00.663753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 254/509] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:00.665301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.669882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.716154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.717609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.764288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817bd8b-bc61-4004-bbf7-bbbc2bccb528 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.791025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.802869 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.803887 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.804333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.804783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.829760 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 256/510] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:00.830463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.882396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.884155 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:00.895985 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:00.951988 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3385-0fb0-4e2d-837c-d12ec60f8b14 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:00.989404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:00.990126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:00.990405 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:00.990674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:00.997610 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:00.997873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 255/511] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:00.998694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:00.999154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:01.017827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:01.018797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 257/512] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:01.020100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.033886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.110231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df6c8-26c9-45a2-bd5a-0cc85c50a638 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.134689 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178dd1d-d2f7-493d-89ec-616b3066912e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.148661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.149349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.149608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.149859 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.150704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:01.151001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.152445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.154849 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.171068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 256/513] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Jul 23 20:50:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:01.171915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.182171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.182991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.183260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.183527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.195650 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.196754 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:01.214647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:01.215788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:01.216877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:01.216877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:01.216877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:01.216877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:01.216877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 258/514] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:01.217229 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.279368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.304466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98872e-8cc3-4c4a-b151-6b2096c9cf6b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.338942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.339873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.340222 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.340414 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.351891 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.353536 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.363065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a733d-a5eb-4f30-a5f7-54ff532a15fe None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:01.372927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:01.374047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 257/515] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:01.375083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.401278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.401954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.402234 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.402507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.403293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:01.403603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.405078 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.429684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 259/516] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:01.430555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.460226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.489584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c8e2-0cc4-4e2d-b096-8aa756d9752d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.527367 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.528117 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.528404 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.528707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.538336 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.540997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da2de9-e406-4644-9cc9-d92a8e725922 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.583127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.583821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.584104 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.584390 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.585143 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:01.585452 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.586871 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.599430 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 260/517] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:01.600292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.620300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.621852 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.701990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.715216 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119237-5a88-47bc-8ac3-d524bf34262b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.734155 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 258/518] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:01.735015 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.758453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.759123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.759403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.759672 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.760393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:01.760744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.762162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.779775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 261/519] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:01.779958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:01.780561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.846612 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdb45-979c-4120-a0f0-16083d03ce66 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.883170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.883836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.884147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.884417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.885603 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=ee135c0b41e1474686678d60dc5018ca) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:01.886111 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.888267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.905445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 259/520] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/role_assignments?user.id=ee135c0b41e1474686678d60dc5018ca&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:01.905445 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:01.917920 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627926-f85e-4187-9183-f300d4808b49 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:01.967641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:01.968454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:01.968876 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:01.969153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:01.977380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:01.978975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:01.995668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:01.996702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:01.997674 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 262/521] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:01.998855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.013979 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.034102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0a8c-f97c-4081-b9a2-398310066d61 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.036764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.077093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.077913 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.078202 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.078473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.092381 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.094091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:02.118646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:02.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:02.121928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:02.121928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:02.121928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:02.121928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:02.121928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 260/522] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:02.125970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.132032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb6bd-fe2c-431e-924c-5c98b5cded65 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.170170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.171343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.171841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.172212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.180985 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.182537 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:02.198492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:02.199399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:02.200227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 263/523] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:02.200734 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.256925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef0d42-b6d2-46ff-8f07-ae9e05f71069 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.291050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.303510 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.304235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.304509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.304880 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.306485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:02.306485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.307828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.332174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 261/524] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:02.332174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.341631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c716-7440-4165-abbe-b56a786e01b0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.351425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.386197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.386858 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.387138 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.387412 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.388737 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:02.389054 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.390452 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.409354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 264/525] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:02.415074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.458696 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf3ed-b54a-46c4-8707-9641bd49a53d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.505231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.505909 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.506189 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.506459 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.507252 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:02.507559 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.509064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.522285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 262/526] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:02.523231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.544462 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83badd03-13c9-4b03-8fd6-9cb2c585b75d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.576872 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.588119 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.589301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.589842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.590365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.591970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=989a9c4b74df4fc1b4a4351652ed499a) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:02.592716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.594635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.602035 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 265/527] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/role_assignments?user.id=989a9c4b74df4fc1b4a4351652ed499a&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:02.602760 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.626223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.663792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1face-ea9b-4be9-bcca-909e320f6098 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.718126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.719851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.720582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.721249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.731413 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.734158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.747787 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162b5a-03f0-42a8-8033-3a0d95fd1cb9 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:02.754879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:02.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:02.757259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:02.758923 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 263/528] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:02.765164 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:02.801912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.803162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.804042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.804509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.805857 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=724caa2823654664b693e9a7edad2539) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:02.806360 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.808932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.816581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 266/529] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/role_assignments?user.id=724caa2823654664b693e9a7edad2539&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:02.907787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1ad5-e3b2-4331-85b4-1636ad0d6666 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:02.952430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:02.953152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:02.953431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:02.953703 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:02.954514 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:02.954821 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:02.956373 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdd327-344e-44da-a4fd-e55ae47037b6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:02.958399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:02.972640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 264/530] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:02.978927 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:03.051605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:03.105780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fea841-5790-4aca-a2a1-67e575de8b91 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:03.143776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:03.144741 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:03.145188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:03.145616 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:03.146621 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=e27cdef8bd764dbf8243a4e0f4d8102a) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:03.147085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:03.148726 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98f9b-4114-4f55-b6c4-d33766dbde85 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:03.155718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 267/531] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:02 2022] GET /identity/v3/role_assignments?user.id=e27cdef8bd764dbf8243a4e0f4d8102a&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:04.206069 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5461-6334-4215-a406-228a93839d75 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.207104 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5461-6334-4215-a406-228a93839d75 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.207610 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5461-6334-4215-a406-228a93839d75 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.209262 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 265/532] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:04.215428 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.215961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.215961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.234164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:04.235388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:04.308259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 268/533] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:04.332470 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5461-6334-4215-a406-228a93839d75 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:04.439992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5461-6334-4215-a406-228a93839d75 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:04.477297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:04.478032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.478305 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.478574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.490976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:04.498904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:04.499884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:04.500717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 266/534] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:04.508018 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:04.562285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:04.615451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f59bb-2142-4fd3-ae31-4d9b5e878e21 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:04.651531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:04.652593 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.653128 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.653597 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.654624 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:04.655148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:04.656792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:04.666466 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 269/535] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:04.672300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:04.731708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:04.787608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69951f-71ca-4bbf-8635-70ff02ad77de None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:04.824199 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:04.825029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.825301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.825573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.837359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:04.838876 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-c9144fc4-9538-49da-a0e0-12c8ed2fff51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:04.857216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:04.858179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:04.859051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:04.859051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:04.859051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:04.859051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:04.859051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 267/536] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:04.865631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:04.937187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a69ec-3b85-425e-9aa6-a5585a796d00 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.938291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a69ec-3b85-425e-9aa6-a5585a796d00 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.939059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a69ec-3b85-425e-9aa6-a5585a796d00 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.941098 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 268/537] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:04.946710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:04.946995 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:04.947330 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:04.964503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:04.965566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:04.985145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce51f8-f2a6-4158-9bc9-15c9a6df3338 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.000192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.024427 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.025317 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.025925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.026272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.027143 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:05.027559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.029236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.049620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 270/538] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:05.050793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.060100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 269/539] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:50:05.078031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.114055 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.173855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd596e-0a9e-4d0c-8975-cb8903624c9c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.183669 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd79bf-005d-48b4-9279-3d7625d66962 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.215284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.216119 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.216782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.216782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] PATH_INFO: `/v3/users/nova` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.220892 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a745e0c-1a5f-4634-a358-145b09109ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.221700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a745e0c-1a5f-4634-a358-145b09109ba8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.221980 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a745e0c-1a5f-4634-a358-145b09109ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.222251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a745e0c-1a5f-4634-a358-145b09109ba8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.224320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.225803 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.233269 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a745e0c-1a5f-4634-a358-145b09109ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:05.252968 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:05.253913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:05.254799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-4a745e0c-1a5f-4634-a358-145b09109ba8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:05.255814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:05.256738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 270/540] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:05.257519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976820c-6234-4442-8f5d-cabd2d5d5207 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.260558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976820c-6234-4442-8f5d-cabd2d5d5207 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.260558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976820c-6234-4442-8f5d-cabd2d5d5207 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.260558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 271/541] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:05.260990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 271/542] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:05.261139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976820c-6234-4442-8f5d-cabd2d5d5207 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.261283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.289888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.382815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.391245 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976820c-6234-4442-8f5d-cabd2d5d5207 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.391994 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8ca3-ba16-4089-a300-a7df09f275db None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.429166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a670151-153c-4774-ad68-80119df83256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.429836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.430146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a670151-153c-4774-ad68-80119df83256 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.430426 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a670151-153c-4774-ad68-80119df83256 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.430524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.430715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a670151-153c-4774-ad68-80119df83256 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.430811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.431027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.431529 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a670151-153c-4774-ad68-80119df83256 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:05.431767 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:05.431870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a670151-153c-4774-ad68-80119df83256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.432070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.433304 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a670151-153c-4774-ad68-80119df83256 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.433501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461a13e-f17a-4223-9641-58f35acc8204 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.442921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 272/543] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:05.444189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.444470 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.444764 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.458297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 272/544] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:05.459416 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a670151-153c-4774-ad68-80119df83256 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.460880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:05.462094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:05.530577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 273/545] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:05.531443 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.563436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a670151-153c-4774-ad68-80119df83256 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.565893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.599815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.600648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.600936 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.601211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.611975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.615749 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-9d0eb5a9-7d8d-49cc-8fed-479ded388f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:05.633640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:05.634621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:05.635481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:05.635481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:05.635481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:05.635481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:05.635481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:05.636161 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb4d9-01e0-4b46-9152-ef777e6ba73f None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.636372 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb4d9-01e0-4b46-9152-ef777e6ba73f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.636674 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb4d9-01e0-4b46-9152-ef777e6ba73f None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.637951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 274/547] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:05.638706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb4d9-01e0-4b46-9152-ef777e6ba73f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.648148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.649473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7a4a-8274-4c19-9eac-8acd2129bfd8 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.683905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.684737 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.685011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.685382 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.697640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.699139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:05.716942 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:05.717848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:05.718691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:05.718691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:05.718691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:05.718691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:05.718691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 274/548] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:05.718971 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.745059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb4d9-01e0-4b46-9152-ef777e6ba73f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.779338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b92410-75a2-4f5d-b0e9-bf16900804a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.780139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92410-75a2-4f5d-b0e9-bf16900804a9 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.780408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92410-75a2-4f5d-b0e9-bf16900804a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.780755 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92410-75a2-4f5d-b0e9-bf16900804a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.791850 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92410-75a2-4f5d-b0e9-bf16900804a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:05.798347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-36b92410-75a2-4f5d-b0e9-bf16900804a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:05.799776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:05.800781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:05.801606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 275/549] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:05.802683 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.802843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.803100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.819844 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:05.821091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:05.826814 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77448f91-7812-424f-baa2-8f762ee8931d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:05.862379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:05.863047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:05.863335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:05.863612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:05.864337 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:05.864671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:05.866060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:05.878289 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 275/550] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:05.879126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.881294 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:05.889843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 276/551] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:05.890675 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:05.981624 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecc795-a300-43d5-9625-aa2d483594a7 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.001655 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fada9b0-1215-49fb-9965-4d13c62abeee None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.016161 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.016881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.017158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.017416 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.018130 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:06.018429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.019817 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.022133 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.032459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:06.033274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.042962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.043701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.044345 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.044784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.045867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:06.046179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.047573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.056249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:06.057130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.118124 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.134560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3dd66-f926-4c57-8174-540dc625b963 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.166302 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b9663-8460-48d3-9637-3b0ccc9478f7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.170894 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.171707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.171986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.172258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] PATH_INFO: `/v3/users/glance` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.179806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.181314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:06.196055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:06.197285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 277/554] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:06.198488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.205231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.206048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.206331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.206607 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.217863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:06.225630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:06.227026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:06.227851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:06.231733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 278/555] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:06.232797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.263320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.309660 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c02456-6a3b-44f7-937d-d917cdce6a7e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.337483 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ea6f-899a-4cd8-a1bb-198ad9be3b11 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.345782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.346594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.346873 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.347146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.354354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.355811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.356377 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:06.369991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:06.370907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:06.371780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 278/556] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:06.372440 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.378093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.378897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.379177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.379450 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.390755 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.392247 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:06.409797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:06.410736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:06.412156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:06.412156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:06.412156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:06.412156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:06.412834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:06.413638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.477928 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7da101-2fc6-4d68-b641-b8215843f4ef None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.494268 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.513533 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.514053 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0123aa4-a905-43a5-92c0-e4f7615132a7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.514208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.514487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.514760 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.515597 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:06.515903 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.517374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.534890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:06.535782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.550074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.550766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.551042 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.551317 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.552064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:06.552356 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.553820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.562570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:06.563322 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.595175 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.641153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413916-4354-407a-9dc6-afaa5df77d37 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.665781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769305ee-e29f-46e0-8862-514c9625ee03 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.677568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.678248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.678526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.678797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.679580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:06.679884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.681357 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.693202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:06.694050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.702447 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.703119 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.703402 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.703819 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.704543 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:06.704878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.706302 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.718549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:06.719362 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.729758 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.797364 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dcb1f-e68e-44d7-ba5b-d7b25f4459f0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.811930 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.822066 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e521-8a29-4ee6-83b3-f95788dd677f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.831892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.832733 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.832983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.833274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.844349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.845875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.857441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:06.858231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:06.858529 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:06.858797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:06.862947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:06.863836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:06.864847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:06.864847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:06.864847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:06.864847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:06.864847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:06.865141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.869430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:06.870903 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:06.889429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:06.890393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:06.891321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:06.891321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:06.891321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:06.891321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:06.891321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:06.891612 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:06.961261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:06.976747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda351aa-c0c0-4710-8a9f-fd8a8036e6f5 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:06.999318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8306-a3f0-4cd4-b54c-f5f8d267739c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.011790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.012747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.013010 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.013324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/ee135c0b41e1474686678d60dc5018ca/roles/6e6f08ddea5b4aabbf786138db459d6a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.029745 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=ee135c0b41e1474686678d60dc5018ca, role_id=6e6f08ddea5b4aabbf786138db459d6a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.031211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.036468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.037459 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.037804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.038191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.045794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 282/564] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:50:06 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/ee135c0b41e1474686678d60dc5018ca/roles/6e6f08ddea5b4aabbf786138db459d6a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:50:07.046632 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.047298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.048823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:07.064914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:07.066049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:07.072253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.075147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.177589 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93573d-c3bd-4e78-ae7b-e6ab438f2829 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.198295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668177-2da2-4155-8b2b-54eb098f0ebd None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.221389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.222074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.222362 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.222630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.223371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:07.223686 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.225132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.228772 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.244509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:07.245838 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.259994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.260697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.260979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.261253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.261983 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:07.262291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.263778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.278507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:07.279240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.346992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.364658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a15f-efa8-4953-bc14-466c2109c0b5 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.387590 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e430a40-540f-48e0-a986-76c5bfeea5d7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.403182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.404207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.404750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.405408 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.406282 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:07.406594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.408056 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.429308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.431443 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.431799 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.432161 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.437730 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:07.437730 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.444786 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.446458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:07.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:07.462149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:07.463311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:07.467035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 285/569] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:07.467919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.505651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.557890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae119814-8c7f-47ed-91ec-9ada1ab0d9c1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.583639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10cdaf-1701-4b1c-8fe9-b86d03665a06 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.594835 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.595732 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.596079 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.596352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.604880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.606393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.608173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.619201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.620093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.620443 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.620816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:07.624081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:07.625244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 285/570] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:07.626467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.637503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.639246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:07.662497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:07.663715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:07.665187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:07.665187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:07.665187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:07.665187 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:07.665781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:07.666632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.761346 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeef22-8204-44e1-95fa-868b9645b948 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.778065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.790571 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866c29-57c7-4ea7-a353-aee3de1b1d0a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.803542 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.804226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.804508 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.804820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.805659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:07.805960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.807432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.820829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:07.820829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.833537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.834307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.834650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.835099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.835960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:07.836336 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.837957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.857541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:07.862417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:07.900752 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:07.934069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2041d-4260-4c7b-8e98-4b8670f1b901 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.971006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:07.971678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:07.971960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:07.972237 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:07.972814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709782-29a4-48d6-8868-6c584d9b816c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:07.972986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:07.974258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:07.976740 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:07.991952 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 287/574] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:07.992919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.017516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.018427 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.018700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.018974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/989a9c4b74df4fc1b4a4351652ed499a/roles/6e6f08ddea5b4aabbf786138db459d6a` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.034029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:08.036460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=989a9c4b74df4fc1b4a4351652ed499a, role_id=6e6f08ddea5b4aabbf786138db459d6a)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.037500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.051687 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 288/575] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:50:07 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/989a9c4b74df4fc1b4a4351652ed499a/roles/6e6f08ddea5b4aabbf786138db459d6a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:50:08.052994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.125432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11006-4975-4bdb-bfe6-a9340284fb43 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.154610 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:08.171241 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.172536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.173116 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.173634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.173878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467a02-f1d1-486b-87a7-6b4b6183bc16 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.187414 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.189439 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:08.212198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:08.213324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:08.214422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:08.214422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:08.214422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:08.214422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:08.216736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.221824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.221824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.221824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.222742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 288/576] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:08.224752 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.228775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.230588 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:08.252849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:08.253822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:08.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:08.259270 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.352433 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:08.375103 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04852cb-b520-4325-8aeb-c900a8a383b7 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.384153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ecb5-1b7e-423e-b97f-b2af8f3ed7d2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.420194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.421053 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.421345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.421910 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.422941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:08.423242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.424945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.426670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.427361 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.428110 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.428393 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.429232 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:08.429540 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.431057 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.438433 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 289/578] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:08.445626 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.448303 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:08.453899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.457709 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:08.560904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798154c-1332-498f-9c65-afede31ed86e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.575731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571ac1-123d-4f0c-8c9e-35c49346aa9b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.597801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.598871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.599250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.599622 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/724caa2823654664b693e9a7edad2539/roles/6e6f08ddea5b4aabbf786138db459d6a` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.617328 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=724caa2823654664b693e9a7edad2539, role_id=6e6f08ddea5b4aabbf786138db459d6a)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.619111 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.619747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.620567 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.620882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.621156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.631381 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.633199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.645071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 291/580] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:50:08 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/724caa2823654664b693e9a7edad2539/roles/6e6f08ddea5b4aabbf786138db459d6a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:08.648706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:08.650491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:08.652367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:08.657020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:08.657330 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.721775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:08.779976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced90d71-5d3b-48ac-b728-b53231f64e46 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.819415 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.820161 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.820447 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.820756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:08.821562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:08.821869 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:08.823497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daea5b-9d84-42bc-be04-92687a25192d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:08.837927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:08.844347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:08.854135 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:08.957306 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1f6f-5a11-49e8-898c-4829171e71b6 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:08.993236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0459-ad64-4d92-a748-5f6a47907116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:08.994169 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0459-ad64-4d92-a748-5f6a47907116 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:08.994445 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0459-ad64-4d92-a748-5f6a47907116 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:08.994718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0459-ad64-4d92-a748-5f6a47907116 None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/e27cdef8bd764dbf8243a4e0f4d8102a/roles/6e6f08ddea5b4aabbf786138db459d6a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:09.010591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b0459-ad64-4d92-a748-5f6a47907116 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=e27cdef8bd764dbf8243a4e0f4d8102a, role_id=6e6f08ddea5b4aabbf786138db459d6a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:09.012060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b0459-ad64-4d92-a748-5f6a47907116 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:09.032808 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 291/583] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:50:08 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/e27cdef8bd764dbf8243a4e0f4d8102a/roles/6e6f08ddea5b4aabbf786138db459d6a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:50:09.357599 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127af4-92ed-4b61-902c-b56512e7e7d9 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:09.357992 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127af4-92ed-4b61-902c-b56512e7e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:09.358189 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41127af4-92ed-4b61-902c-b56512e7e7d9 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:09.359764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 293/584] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:09.370084 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:09.370395 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:09.370628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:09.395114 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:09.396348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:09.453192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:09.474841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 292/585] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:09.499257 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127af4-92ed-4b61-902c-b56512e7e7d9 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:09.608595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41127af4-92ed-4b61-902c-b56512e7e7d9 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:09.623258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:09.644316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:09.645155 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:09.645436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:09.645710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:09.656153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:09.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:09.665279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:09.666143 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:09.675707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:09.782864 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b47bab-2e7e-446b-ba0d-b4281c675e06 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:09.819735 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:09.820415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:09.820725 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:09.820999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:09.821760 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:09.822064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:09.823470 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:09.833034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:09.841855 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:09.952945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684c39-31d9-44cc-90c5-bf87746b5b46 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:09.988968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:09.990232 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:09.990707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:09.991170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.006855 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:10.008823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:10.031221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:10.032177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:10.033505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:10.033505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:10.033505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:10.033505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:10.037311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:10.043646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:10.113783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:10.167936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007bf9e-81b5-4117-b4ab-f33f515a291e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:10.203737 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:10.204786 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.205261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.205750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.206697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:10.207191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:10.208781 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:10.222983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:10.228938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:10.261072 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:10.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e7cd0-a7a3-4e6a-9fcc-45b6f2bff0f3 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:10.386755 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:10.388873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.389665 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.390410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.400830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:10.402749 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-3f94d71f-1816-4e10-8502-82a32dd67d7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:10.418465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:10.419582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:10.420596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:10.423333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:10.429313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:10.433457 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a7b8a-fc95-4f1b-89bf-6db169b98da5 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.433748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a7b8a-fc95-4f1b-89bf-6db169b98da5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.434029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a7b8a-fc95-4f1b-89bf-6db169b98da5 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.435595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 297/591] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:10.440565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c43e-1428-4519-af44-823c12636d35 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.440881 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c43e-1428-4519-af44-823c12636d35 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.441159 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c43e-1428-4519-af44-823c12636d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.459087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-8675c43e-1428-4519-af44-823c12636d35 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:10.460226 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-8675c43e-1428-4519-af44-823c12636d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:10.536895 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 298/592] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:50:10.553546 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bc15e-92bf-45b7-9e6e-0c2d0296a5f4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:10.566037 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675c43e-1428-4519-af44-823c12636d35 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:10.570453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:10.586378 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:10.605514 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:10.606704 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.608137 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.608589 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.609641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:10.610111 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:10.611725 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:10.639036 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 295/593] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:10.640027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:10.695463 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675c43e-1428-4519-af44-823c12636d35 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:10.742478 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:10.744083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.744519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.744959 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.746388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585dd87-c83d-4c67-acec-5870019c92bd None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:10.758747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:10.768988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:10.770186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:10.771212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:10.778890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 299/594] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:10.779681 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:10.795219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:10.796244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.796967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.797967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.844773 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:10.868188 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:10.894858 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:10.896991 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:10.897417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f8cda-8dbe-4d5d-8805-e7adb7c74d7d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:10.942186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:10.942960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:10.943395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:10.943638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:10.945319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:10.945766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:10.947301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:10.961564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 300/595] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:10.963486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.048817 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 296/596] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:50:11.049918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.091787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036a083-50ab-4821-9112-f6cced622b58 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.121705 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.127836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.128756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.129041 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.129316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.143131 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.149149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.151709 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-434b6675-41f8-40c5-b942-ad266c740c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:11.171826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:11.173576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:11.175198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:11.175198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:11.175198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:11.175198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:11.175613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214eddb-fcf4-4e9d-a785-e9946fc376c8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.178777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 301/597] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:11.179362 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7fcb-3432-472a-8aea-9057a925cebb None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.179650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7fcb-3432-472a-8aea-9057a925cebb None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.179931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7fcb-3432-472a-8aea-9057a925cebb None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.184662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 302/598] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:11.184662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b7fcb-3432-472a-8aea-9057a925cebb None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.221662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.222488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.222770 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.223045 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.234398 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.235918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-8f37587a-451c-4cc2-9f94-a96e4da0cd9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:11.255879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:11.256775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:11.257681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:11.257681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:11.257681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:11.257681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:11.261842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 297/599] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:11.263595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.263595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.263805 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.282753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:11.284211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:11.317184 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b7fcb-3432-472a-8aea-9057a925cebb None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.367841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.368522 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.368870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.369146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.376676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 298/600] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:11.376897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:11.376897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.377050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.377122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.392220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 303/601] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:11.394127 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.435243 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.449913 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.491511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80214fe-78f0-4577-8c07-6a06bda4fd38 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.504225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9ca6-fccc-44fd-8ef0-03be55cb2a5a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.528686 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.529426 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.529706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.529981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.530711 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:11.531016 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.532414 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.538736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.539904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.540180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.540453 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] PATH_INFO: `/v3/users/glance` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.544672 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 299/602] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:11.545494 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.548209 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.549713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-86688afb-b957-4fb1-9fdb-c2e01886673c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:11.564488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:11.565716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 304/603] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d378ba-4586-4689-b395-82446f4c9f21 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.567420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d378ba-4586-4689-b395-82446f4c9f21 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.568140 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d378ba-4586-4689-b395-82446f4c9f21 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.573351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 305/604] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:11.573351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d378ba-4586-4689-b395-82446f4c9f21 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.651335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033ad53-d4bf-49ed-b2ae-1e62ee5795fe None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.660779 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.674288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d378ba-4586-4689-b395-82446f4c9f21 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.686427 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.688022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.688903 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.689188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.689454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.700171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:11.707966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:11.708939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:11.709778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 300/605] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:11.710629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.716167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.717091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.717413 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.717655 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.726036 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.727515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-4edef185-731d-4d52-9240-c093178e72ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:11.743103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:11.744185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:11.745144 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 306/606] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:11.745635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.745840 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.746128 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.763111 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:11.764240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:11.823637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda7dc-0ace-44b9-8d4b-59823a280547 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.833631 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 307/607] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:11.834502 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.870051 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.870731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.871013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.871287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.872126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:11.872437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.873957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.892470 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 301/608] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:11.893630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:11.923571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.940626 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:11.945214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a648e77-08a4-44a4-ac31-a4582bf0e7ed None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:11.980679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:11.981407 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:11.981710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:11.982071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:11.984150 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:11.984150 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:11.984629 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:11.993408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 308/609] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:11.994034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.003008 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa175dfe-3391-4955-91f2-bf2902c7777d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.040702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.041360 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.041644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.041932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.042719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:12.043027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.044587 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.056530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 302/610] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:12.057379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.095920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321a2b4-8daa-431a-b7c0-850c8218f2ed None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.131251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.132065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.132345 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.132646 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.143522 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:12.149325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:12.151152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:12.152093 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 309/611] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:12.153456 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.170785 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa6c2-b329-4fc5-99b8-f77ecedd7242 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.179615 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.204490 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.205181 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.205462 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.205747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.257901 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7b68f-c77a-482a-95d5-ed469b5fd27e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.280433 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.282034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.292746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.293551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.293829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.294099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.305146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.306607 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:12.324178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:12.325170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:12.326079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:12.326079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:12.326079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:12.326079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:12.326079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 310/612] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:12.326347 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.372662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.389371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 303/613] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:12.390223 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.403713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.428918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedc3da-e1aa-4bff-a46e-80c6e6ff79c8 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.462742 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.463407 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.463690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.463959 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.464809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=ee135c0b41e1474686678d60dc5018ca) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:12.465118 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.466638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.473134 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 311/614] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/role_assignments?user.id=ee135c0b41e1474686678d60dc5018ca&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:12.473941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.493453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589098e9-9aa9-46c0-9e53-5d9e825aff80 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.532288 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.533024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.533321 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.533581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.534358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:12.534658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.536113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.545950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 304/615] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:12.546842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.603078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32222a7-1203-4a51-b426-a0fa8e0575d6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.608179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.643573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.644168 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.644451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.644769 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.645497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:12.645957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.647219 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.655447 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.663164 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 312/616] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:12.664270 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.677950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a97fc-c835-4e9d-a08f-97c32e747d3a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.719603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.719603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.719888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.722324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.735049 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.736566 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:12.754168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:12.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:12.756017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:12.756017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:12.756017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:12.756017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:12.756017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 305/617] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:12.757081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.780318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e312-c11e-4213-a264-51f1aee11b5e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.816783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.817591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.817879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.818165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.829173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.830649 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:12.849776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:12.850737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:12.851609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:12.851609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:12.851609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:12.851609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:12.851609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 313/618] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:12.852349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.867215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.870449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5190ef6-7ae8-4dcc-805f-d088dc1e4eea None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:12.908884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:12.909261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:12.910088 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:12.910372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:12.910645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:12.919935 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:12.921451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:12.936485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:12.937649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 306/619] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:12.938659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:12.969006 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b89e74-8cf0-4f90-999a-7e6dc5c50b1a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.008368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.009071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.009351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.009632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.010360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:13.010660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.012099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.024184 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 314/620] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:13.025062 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.055505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef198a-222e-4cea-aeee-865949712845 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.092574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.093289 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.093574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.093851 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.094579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:13.094889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.096352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.109274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 307/621] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:13.110133 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.139940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.142403 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1064b1-14e4-43b1-8265-48e801146c52 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.154700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.181068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.181863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.182154 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.182407 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.183243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:13.183549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.185101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.208912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 315/622] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:13.209843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.227040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04323-b423-4bdf-a628-6c339bcc26cb None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.272362 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.273242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.273521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.273794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.281464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.282947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:13.297840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:13.298951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:13.300069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:13.303693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 308/623] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:13.304616 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.326449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81739374-23d0-48b3-9f58-6194b38c13f8 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.361835 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.362608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.362886 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.363157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.370649 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.372110 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:13.386570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:13.387555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:13.388628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 316/624] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:13.389272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.397659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.418736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355f7c5-94e0-40dd-88da-a00e90ee75c7 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.422768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.454172 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.454744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.455033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.455308 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.511021 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832446c-a34f-4cc7-b071-486c76893de0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.537432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.539268 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.553021 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.553732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.554076 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.554285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.555078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:13.555389 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.556863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.569138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 317/625] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:13.570249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.630006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.656747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 309/626] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:13.657681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.665214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.679001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501925-0189-45aa-be55-9f83a3c80d65 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.714916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.715506 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.715787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.716062 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.717013 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:13.717314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.718771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.737192 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 318/627] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:13.738045 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.775615 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e217d-f774-4a21-89d7-df1dd64d3841 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.814994 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.815917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.816340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.816815 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.817792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=989a9c4b74df4fc1b4a4351652ed499a) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:13.818255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.820254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.833007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 310/628] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/role_assignments?user.id=989a9c4b74df4fc1b4a4351652ed499a&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:13.834011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.854061 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fbb6b-7a60-4e44-a0f9-11ec09563c02 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:13.887512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.906518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:13.907712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:13.908193 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:13.908705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:13.921351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:13.923218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:13.931979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:13.945401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:13.946479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:13.947897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:13.947897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:13.947897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:13.947897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:13.950029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 319/629] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:13.955440 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:13.968936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417339a-b1fa-4f45-a76f-39cc07b6af79 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.011294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.011956 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.012230 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.012507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.094571 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ee903-2ed8-46a7-98ed-236c2aef12b6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.109039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.110534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.150581 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.151258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.151536 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.151811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.152523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:14.152846 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.164424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.174418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 320/630] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:14.179045 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.193110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:14.266152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:14.284039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 311/631] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:14.291816 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.323134 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63c1b-a8bc-4268-a8da-ed761333f888 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.367199 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.369138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.369601 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.370044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.380029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.382291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:14.402552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:14.403500 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:14.404515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:14.406191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 321/632] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:14.410734 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f750e6-8dd3-4dc2-8e2b-7fe146caea9e None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.411449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.451009 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.451813 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.452095 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.452373 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.464372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.465963 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.470987 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:14.490856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:14.491821 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:14.492738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:14.492738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:14.492738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:14.492738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:14.496855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 312/633] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:14.498413 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.551834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f14f-cb59-42de-8b9e-372422595f27 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.578920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:14.601859 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.603551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.604195 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.604768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.605954 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:14.606448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.608733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.609702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576f359-f3d5-44ab-8260-90f981aa5d6f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.628248 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 322/634] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:14.629531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.666909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.668291 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.668757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.669208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.670140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:14.670771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.673358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.689020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 313/635] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:14.696345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.746814 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb01bb-0473-4254-88df-37717eb976f2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.770164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:14.783229 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.783963 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.784300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.784699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.785584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=724caa2823654664b693e9a7edad2539) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:14.785955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.787502 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7e6c-1e65-4d6c-a326-dbe7efb0b69b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.799916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 323/636] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/role_assignments?user.id=724caa2823654664b693e9a7edad2539&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:14.802670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11717-da2c-438a-92f8-82dd548528d8 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.803221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11717-da2c-438a-92f8-82dd548528d8 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.803221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11717-da2c-438a-92f8-82dd548528d8 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.808947 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 324/637] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:14.810453 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.810747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.811027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.830146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb2285-21ef-44d6-8854-3d29f622813c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:14.832225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:14.834594 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:14.870309 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:14.871149 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:14.871427 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:14.871702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:14.876444 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:14.880050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:14.881599 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:14.898189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:14.899345 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:14.905250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 314/638] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:14.907547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:14.928708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 325/639] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:14.958855 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:15.036106 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86682-7e73-4e80-93b7-6f1c510df85a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.059660 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:15.074817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c7b8f-7737-44cb-89db-75e97411334c None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.094573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.095406 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.095749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.096061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.096871 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:15.097173 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:15.098636 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:15.114609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 315/640] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:15.120179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:15.122464 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.123433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.123633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.123909 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.135882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:15.143458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:15.144507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:15.145476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 326/641] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:15.154847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:15.201600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:15.245175 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31a261-4c4d-48e8-9eed-0e4c4aec956f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.289239 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb463a3-bcdb-4868-93e8-edb87374c267 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.293306 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.294263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.294789 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.295263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.296313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=e27cdef8bd764dbf8243a4e0f4d8102a) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:15.297287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:15.299326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:15.308260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 316/642] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:15 2022] GET /identity/v3/role_assignments?user.id=e27cdef8bd764dbf8243a4e0f4d8102a&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:15.329314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.329917 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.330198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.330468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.331291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:15.331596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:15.333112 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:15.344007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 327/643] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:15.349630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:15.403349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:15.477613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a476-cff0-48cb-a1a7-242654cf7ce2 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.522766 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.523608 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.523864 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.524134 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.538482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:15.540311 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:15.559339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:15.560389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:15.561333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:15.561333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:15.561333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:15.561333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:15.561333 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 317/644] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:15.566733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:15.666977 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:15.674558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5805-4b00-4ea5-af30-7ec99a2220f4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.710436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.711480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.711977 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.712444 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.713505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:15.714008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:15.715582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:15.728630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 328/645] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:15.736877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:15.835274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:15.845687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29e83a-6b3d-4f1b-a6d1-a003ab684293 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:15.886082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:15.886973 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:15.887364 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:15.887637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:15.896292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:15.897840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:15.911962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:15.912962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:15.914254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 318/646] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jul 23 20:50:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:15.919652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.022162 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed22f5-7606-47bb-8d97-d37ec10d75fd None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.057236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.058347 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.058864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.059337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.060509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:16.061069 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.062824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77758e-6d76-462d-ab49-308466af6cda None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.086006 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 329/647] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jul 23 20:50:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:16.092019 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.200261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b2c68-3ede-46d4-8d3d-b080726fb6f3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.233812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6adb0b-e8e1-4f04-bd6c-de75b0978f99 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.234208 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6adb0b-e8e1-4f04-bd6c-de75b0978f99 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.234492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6adb0b-e8e1-4f04-bd6c-de75b0978f99 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.236749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.236879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 330/648] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:16.236958 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.236958 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.237106 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.244179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.244801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.245292 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.263895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:16.269217 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:16.270694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:16.280134 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:16.311512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.312996 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.351702 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 331/649] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:50:16.372868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.417937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 319/650] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:50:16.423322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.484720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0009de4-3ea4-425e-b392-b42979d7b8bc None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.488269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:16.524357 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.525318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.525618 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.525976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] PATH_INFO: `/v3/services/image` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.526643 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.528070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.542344 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfb0ee-edd1-4366-b230-5ae685aec8f1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:16.543768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:16.544918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:16.545766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 332/651] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:16.551163 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.561587 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:16.594944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.595759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.596036 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.596307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.616534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.619109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:16.644992 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:16.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:16.648329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:16.648329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:16.648329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:16.648329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:16.652774 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 320/652] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:16.653808 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.677897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa609e-c91d-465f-b7fc-e08d33e7706f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.724681 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.725905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.726316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.726598 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.727574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] RBAC: Adding query filter params (name=image) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:16.727885 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.730078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.737818 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 333/653] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:16.746616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.775574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d77500-b862-4daf-8937-41f752ed0069 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.779068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:16.821934 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.822691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.822973 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.823245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.823972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:16.824275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.825760 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.831406 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:16.845535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 321/654] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:16.848696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:16.881117 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643bb1-4eec-40ad-b6cb-965fc9be6cb6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:16.921458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:16.923267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:16.923842 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:16.924320 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:16.925334 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:16.925938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:16.927744 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:16.940504 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 334/655] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:16.969263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24166ef-5af8-43f1-b822-ec1074e635b6 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:17.008412 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:17.009197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.009479 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.009757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.017851 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:17.019564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:17.035908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:17.036911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:17.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 322/656] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:17.045417 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:17.168436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1c80c-b77c-467c-a690-efd77a3a57c2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:17.217846 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:17.218944 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.219489 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.219971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.221043 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:17.221569 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:17.224762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb7bd-bf4c-4931-b553-daad6267d828 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:17.226986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:17.242089 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 335/657] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:17.248696 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:17.277825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:17.315680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ffe6-69cd-400b-ad72-d420a75f5080 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.316410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ffe6-69cd-400b-ad72-d420a75f5080 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.316823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ffe6-69cd-400b-ad72-d420a75f5080 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.318717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 336/658] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:17.324509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.324936 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.325313 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.344595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:17.346149 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:17.368068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77485aa-a18f-4c79-9d77-c425210c3edf None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:17.410681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:17.411363 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.411642 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.411957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.412944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=ee135c0b41e1474686678d60dc5018ca) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:17.413259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:17.415177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:17.422555 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 323/659] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:17 2022] GET /identity/v3/role_assignments?user.id=ee135c0b41e1474686678d60dc5018ca&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=d384469b72f5485190c772f8974438e0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:17.438377 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 337/660] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:17.463423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:17.577273 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:17.592784 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e78d-9a55-4424-a97a-ba399084865d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:17.636401 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:17.637706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.637974 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.638296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.639003 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:17.640456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-bad4f18e-0465-42ca-9369-acd15e64b139 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:17.656040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:17.657101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:17.657921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 324/661] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Jul 23 20:50:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:17.664026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:17.765628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9186b-f27a-43a7-bb49-7789400320a5 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:17.791737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:17.792262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00005621-9535-4d5b-b2f9-a41931029f88 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.792750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00005621-9535-4d5b-b2f9-a41931029f88 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.792831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00005621-9535-4d5b-b2f9-a41931029f88 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.798146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 325/662] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:17.799844 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.800129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.800403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.807715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:17.808718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.809192 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.809653 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.810608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:17.811101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:17.812730 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:17.818220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 338/663] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jul 23 20:50:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:17.818552 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:17.819771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:17.826324 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:17.908041 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 326/664] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:50:17.936652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:17.937684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0666c1e-43f9-4f22-b226-b647b8e1002a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:17.978631 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:17.979213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:17.979586 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:17.979952 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:17.980864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:17.981267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:17.982976 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:17.996640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 339/665] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jul 23 20:50:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:18.035993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:18.059586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e35c6-b0fa-48eb-b596-97815092db73 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:18.098774 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:18.099631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:18.099962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:18.100243 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:18.100955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:18.102383 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:18.115224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:18.116301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:18.117182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 327/666] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:17 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:18.125132 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:18.184740 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:18.248287 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b140a-f5ba-420b-873e-7bfbbdc65f1a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:18.289383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:18.290071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:18.290358 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:18.290623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:18.291337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] RBAC: Adding query filter params (name=network) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:18.291642 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:18.293063 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37808ad9-db0e-4938-a4b3-3391a4651f1c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:18.298553 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 340/667] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:18.303997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:18.407194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66d70-7c1e-4adb-acc9-1ccd88ac21f8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:18.443385 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:18.443970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:18.444244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:18.444513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:18.445259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] RBAC: Adding query filter params (type=network) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:18.445617 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:18.447004 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed422c-9e1d-4d19-8d67-18e2d10d6af1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:18.456810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 328/668] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:19.323081 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3868af-119b-467b-97cc-8dfd60e23dff None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:19.323608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3868af-119b-467b-97cc-8dfd60e23dff None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:19.323608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3868af-119b-467b-97cc-8dfd60e23dff None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:19.325336 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 341/669] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:19.330870 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044b8f-cb7e-4f23-8817-a3edb1e58659 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:19.331286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044b8f-cb7e-4f23-8817-a3edb1e58659 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:19.331455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044b8f-cb7e-4f23-8817-a3edb1e58659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:19.348548 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-11044b8f-cb7e-4f23-8817-a3edb1e58659 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:19.349777 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-11044b8f-cb7e-4f23-8817-a3edb1e58659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:19.352738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:19.423925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 329/670] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:50:19.447179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3868af-119b-467b-97cc-8dfd60e23dff None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:19.555490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3868af-119b-467b-97cc-8dfd60e23dff None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:19.573112 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:19.591736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80441e91-aaf6-406f-9936-45fad91cad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:19.592416 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441e91-aaf6-406f-9936-45fad91cad83 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:19.592984 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441e91-aaf6-406f-9936-45fad91cad83 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:19.593701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441e91-aaf6-406f-9936-45fad91cad83 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:19.594434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80441e91-aaf6-406f-9936-45fad91cad83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:19.595838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80441e91-aaf6-406f-9936-45fad91cad83 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:19.612640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 342/671] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:50:19 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:19.826534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76b20-e670-4bf4-b137-c884d6ca6ae1 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:19.827042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76b20-e670-4bf4-b137-c884d6ca6ae1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:19.827466 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76b20-e670-4bf4-b137-c884d6ca6ae1 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:19.829325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 330/672] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:19.834851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:19.835411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:19.835906 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:19.853731 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:19.854938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:19.936745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 343/673] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:19 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:19.960506 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76b20-e670-4bf4-b137-c884d6ca6ae1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.069513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76b20-e670-4bf4-b137-c884d6ca6ae1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:20.106069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:20.106932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.107264 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.107545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.116254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:20.119368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:20.127908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:20.128975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:20.129825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 331/674] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:20.136371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.245134 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010b49c-24ce-4eae-8cc1-eb0ba990b994 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:20.247042 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:20.287545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:20.288297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.288578 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.289241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.290023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:20.290335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:20.291866 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bedb38-fb0c-4f96-9886-483ce07f5e7b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:20.302579 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 344/675] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:20.308192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.413432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6027a-3010-4a33-9b9b-7448bd348124 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:20.437966 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fa246-b567-4cd2-aefb-444f58278920 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.438634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fa246-b567-4cd2-aefb-444f58278920 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.438634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fa246-b567-4cd2-aefb-444f58278920 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.440304 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 345/676] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:20.447561 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.448142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.448635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.453790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:20.454728 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.455005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.455274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.467064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:20.467530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:20.468827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:20.469281 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:20.487923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:20.488904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:20.490271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:20.490271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:20.490271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:20.490271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:20.490271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 332/677] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:20.495065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.548631 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 346/678] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:20 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:50:20.552568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:20.572222 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.603431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703e3e-7f14-4271-8371-2b7f85770d4f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:20.649262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:20.654970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.654970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.654970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.654970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:20.654970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:20.654970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:20.673910 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 333/679] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:20.675353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.714256 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:20.723828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239dddb-9b83-4b8e-8375-e8072ef1bf6f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:20.774957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e42e7d-e875-4d78-8501-2d8d4b265cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:20.775652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42e7d-e875-4d78-8501-2d8d4b265cb9 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.775932 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42e7d-e875-4d78-8501-2d8d4b265cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.776205 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42e7d-e875-4d78-8501-2d8d4b265cb9 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.776991 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e42e7d-e875-4d78-8501-2d8d4b265cb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:20.779376 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e42e7d-e875-4d78-8501-2d8d4b265cb9 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:20.805172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 347/680] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:50:20 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:50:20.807453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5e37-b72f-420d-9068-238fd760d7b9 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:20.818634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336e400-34e7-4fc7-8c4f-58f28dd7aacb None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.819237 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336e400-34e7-4fc7-8c4f-58f28dd7aacb None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.819687 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336e400-34e7-4fc7-8c4f-58f28dd7aacb None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.826064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 348/681] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:20.827042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:20.828032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.828503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.829036 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.848063 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:20.849511 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:20.869937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:20.871271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:20.871757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:20.872253 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:20.882270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:20.884432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:20.904634 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:20.905671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:20.906605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:20.909688 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 334/682] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jul 23 20:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:20.909869 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:20.941726 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 349/683] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:20 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:50:20.971853 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:21.049791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9d400-6d26-4c31-ba4e-46b9c0234299 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:21.099709 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:21.100831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:21.101343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:21.101932 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:21.102353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:21.103741 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:21.104271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:21.106123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:21.122034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948763-99b4-4595-b9c9-b96004afa9d2 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:21.129540 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 335/684] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jul 23 20:50:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:21.136278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:21.168537 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:21.176166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:21.178188 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:21.179620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:21.180079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:21.181042 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:21.182616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:21.203523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 350/685] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:50:20 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:21.264090 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec127b-9ec9-40cb-8fc9-810fe0d08bbd None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:21.314089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:21.314967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:21.315250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:21.315522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:21.327659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:21.329214 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:21.349281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:21.350255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:21.351188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:21.351188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:21.351188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:21.351188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:21.351188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 336/686] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:21.356974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:21.472595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119ae4-43b9-4c10-950e-d5f10ba95958 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:21.508347 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:21.509068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:21.509347 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:21.509619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:21.510352 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:21.510660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:21.512066 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:21.527494 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 351/687] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:21.533339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:21.621881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:21.650452 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6362d6-4ce4-417b-8ca6-d8cdfbf88de8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:21.690303 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:21.691126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:21.691404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:21.691678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:21.699649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:21.701265 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:21.717154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:21.719275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:21.721365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 337/688] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:21.724973 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:21.738200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:21.850710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2d56-bb08-486a-9b4a-3f5578658124 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:21.889422 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:21.890154 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:21.890441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:21.890775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:21.891640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:21.891950 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:21.893453 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5d05-6b88-4d6e-8bb6-4884a528ff99 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:21.907462 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 352/689] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:21.913092 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:22.025610 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5986-a759-4da1-bc30-f2382381ec03 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:22.062443 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016112cf-5e32-43cc-90b2-5a482195009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:22.063386 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016112cf-5e32-43cc-90b2-5a482195009c None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.063668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016112cf-5e32-43cc-90b2-5a482195009c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.063981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016112cf-5e32-43cc-90b2-5a482195009c None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/ee135c0b41e1474686678d60dc5018ca/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.066131 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016112cf-5e32-43cc-90b2-5a482195009c None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=ee135c0b41e1474686678d60dc5018ca, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:22.067656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016112cf-5e32-43cc-90b2-5a482195009c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:22.070222 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:22.084474 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 338/690] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:50:21 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/ee135c0b41e1474686678d60dc5018ca/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:50:22.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfce0e-0228-4529-843e-e1dbf0c3b6ae None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.112164 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfce0e-0228-4529-843e-e1dbf0c3b6ae None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.112372 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfce0e-0228-4529-843e-e1dbf0c3b6ae None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.115551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 353/691] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:22.120986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.121361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.121515 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.142261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:22.143532 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:22.224255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 339/692] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:22.248516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfce0e-0228-4529-843e-e1dbf0c3b6ae None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:22.328312 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:22.372177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfce0e-0228-4529-843e-e1dbf0c3b6ae None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:22.408408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:22.409727 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.410223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.410691 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] PATH_INFO: `/v3/services/image` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.411541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:22.413155 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:22.425815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:22.426823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:22.427652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:22.430531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 354/693] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Jul 23 20:50:22 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:22.441753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:22.548875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f925-f0c8-463c-a027-09136f49117e None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:22.573786 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:22.587546 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:22.588139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.588414 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.588710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.589426 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] RBAC: Adding query filter params (name=image) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:22.589728 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:22.591148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:22.600728 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 340/694] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:22.602509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:22.712641 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33aa8-1614-4cf7-bcaa-5f82edee0652 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:22.741387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:22.749483 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:22.750441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.750731 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.751353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.752062 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] RBAC: Adding query filter params (type=image) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:22.752368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:22.753789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:22.759400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 355/695] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:22.765572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:22.869909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee6b3-c91d-408c-96ac-5a741bfc837b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:22.906806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:22.907879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:22.908352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:22.908854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:22.909862 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] RBAC: Adding query filter params (interface=public, service_id=5c7c655e8a504dd6a2b17d9820a7c233, region_id=RegionOne) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:22.910365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:22.911982 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6e1eb-e0d5-47f6-9719-6e5bc9f8a623 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:22.925997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 341/696] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:50:22 2022] GET /identity/v3/endpoints?service_id=5c7c655e8a504dd6a2b17d9820a7c233&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:22.927662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:23.034438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd62e8-ae14-4b2b-bf9b-35f4f9f0b370 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:23.070339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b891b-e0e9-45fb-add9-5cea5cad1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:23.071484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b891b-e0e9-45fb-add9-5cea5cad1e4a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.071957 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b891b-e0e9-45fb-add9-5cea5cad1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.072571 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b891b-e0e9-45fb-add9-5cea5cad1e4a None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.073583 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b891b-e0e9-45fb-add9-5cea5cad1e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:23.076128 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b891b-e0e9-45fb-add9-5cea5cad1e4a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:23.083733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 356/697] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:50:22 2022] GET /identity/v3/services => generated 1002 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:50:23.266828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3041-0e78-4c2c-9c9e-64e2c72af9d8 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.267170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3041-0e78-4c2c-9c9e-64e2c72af9d8 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.267376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3041-0e78-4c2c-9c9e-64e2c72af9d8 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.269151 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 342/698] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:23.274942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01cc0-eb71-4870-b227-785749382302 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.275238 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01cc0-eb71-4870-b227-785749382302 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.275501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01cc0-eb71-4870-b227-785749382302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.294953 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-34f01cc0-eb71-4870-b227-785749382302 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:23.296475 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-34f01cc0-eb71-4870-b227-785749382302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:23.354177 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:23.373440 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 357/699] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:23.397399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3041-0e78-4c2c-9c9e-64e2c72af9d8 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:23.458495 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:23.514890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3041-0e78-4c2c-9c9e-64e2c72af9d8 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:23.554946 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:23.556673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.557139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.557561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.558412 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:23.560274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-6862db8b-7df5-4cc0-9130-80eda84fb4c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:23.574293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:23.575565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:23.576645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:23.579366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 343/700] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Jul 23 20:50:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:23.585067 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01cc0-eb71-4870-b227-785749382302 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:23.689504 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01cc0-eb71-4870-b227-785749382302 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:23.708158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d31c-23bb-4a78-955b-9a47d084fc4d None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.708744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d31c-23bb-4a78-955b-9a47d084fc4d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.709188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d31c-23bb-4a78-955b-9a47d084fc4d None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.712224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 344/701] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:23.716940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.717509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.717998 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.725289 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:23.725963 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.726245 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.726519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.727231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:23.727532 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:23.728970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:23.734353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 358/702] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jul 23 20:50:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:23.739632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:23.741828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:23.743488 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:23.835318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:23.839628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 345/703] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:23.854411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa738-7a4b-40e4-bbf5-deea27b7f856 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:23.863599 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:23.896315 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:23.897388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:23.897951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:23.898418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:23.899377 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:23.899888 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:23.901488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:23.912521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 359/704] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jul 23 20:50:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:23.914215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:23.925604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:23.997643 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d016a7-1f55-4119-8dcf-bfaa723bfa4a None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.036246 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.037483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.037964 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.038455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] PATH_INFO: `/v3/services/network` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.039664 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.041300 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:24.053912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:24.055052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:24.055908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:24.063323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43382bd-41cb-4923-a7df-6a8af7c529fc None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.063954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 346/705] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:23 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:24.065135 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.078328 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:24.110337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.110927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.111207 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.111480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.112956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] RBAC: Adding query filter params (interface=public, service_id=874c878eaee54a218023df89b41d1c50, region_id=RegionOne) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:24.113274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.114672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.125827 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 360/706] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:50:23 2022] GET /identity/v3/endpoints?service_id=874c878eaee54a218023df89b41d1c50&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:24.131537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.183477 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862536f-efb6-45b2-935a-00ff76b96cfc None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.196301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:24.225898 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.226987 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.227476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.227994 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.229049 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] RBAC: Adding query filter params (name=network) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:24.229554 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.231154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.244326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 347/707] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:24.245668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.246444 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931b83e-c9f1-46a0-96d1-75951183b538 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.284059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.284869 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.285151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.285424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.286835 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.287611 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.300904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 361/708] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/services => generated 1002 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 20:50:24.366316 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226d13e-d822-4482-86fb-9ff85f0e1442 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.409355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.410473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.410980 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.411467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.412405 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] RBAC: Adding query filter params (type=network) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:24.412960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.414961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e5825-99ab-420f-9497-b4d1882a212b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.421629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 348/709] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:24.428241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.487191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:24.537928 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c91d-8808-4165-924e-ab91491d9fa7 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.538247 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c91d-8808-4165-924e-ab91491d9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.538858 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c91d-8808-4165-924e-ab91491d9fa7 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.540449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 349/710] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:24.546159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.546569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.546917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.551387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a309a-bf6f-4347-814e-f0a26048217b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.565823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:24.567850 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:24.595584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.596255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.596534 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.596845 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.597799 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] RBAC: Adding query filter params (interface=public, service_id=a4fd938cf6d74df5b681256f22376cde, region_id=RegionOne) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:24.598109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.600142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.606836 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 362/711] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/endpoints?service_id=a4fd938cf6d74df5b681256f22376cde&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:24.609516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:24.612713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.644954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 350/712] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:24.671919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.727721 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52229ae-bb71-492d-841b-73f75a8c3d63 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.737390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:24.773625 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.774680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.775178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.776126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.777361 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:24.779509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:24.787496 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 363/713] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:50:24.792872 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85a77-7928-4ae9-90a8-893c5c207c59 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:24.834451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:24.835539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:24.835995 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:24.836432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:24.849489 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:50:24.857792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:24.859013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:50:24.860034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:24.862629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 351/714] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:24.868503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:24.997272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684dcb2-033a-4eb5-a5a9-6a40af419988 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.041416 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.042383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.042839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.043273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.044178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:25.044672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:25.046218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:25.056189 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 364/715] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:25.061707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.095085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:25.179200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a407-3854-4a8a-8717-b963ba65c776 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.216423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.218060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.218523 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.218962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.231600 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:25.233561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:25.252975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:25.253907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:25.254804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:25.254804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:25.254804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:25.254804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:25.257238 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 352/716] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:25.266032 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.298449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:25.374230 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdf690-cd78-40e2-b78a-a511954ac13e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.412624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.413302 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.414075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.414274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.414985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:25.415290 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:25.416704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f1bf1-5616-4cf1-b1f8-d59321d87b0a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:25.429701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 365/717] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:25.435352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.522187 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:25.539941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be667fc-7a5b-45a8-94bf-95baf3d68ae3 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.540291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be667fc-7a5b-45a8-94bf-95baf3d68ae3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.540498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be667fc-7a5b-45a8-94bf-95baf3d68ae3 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.542335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 366/718] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:25.549339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.549650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.549910 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.555766 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249b8f-c5f7-42ff-a32f-4dd2c35b6fea None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.570099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:25.571746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:25.592192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.593710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.594145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.594581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.603929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:25.605698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:25.623473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:25.624481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:50:25.625434 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:25.628296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 353/719] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:25.633610 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.664942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 367/720] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:25 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:25.682285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.708249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:25.757392 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88020cf4-0509-4e99-99dd-cd38eeeb7099 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.793086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dc597-bc92-4403-add4-36680d0eff60 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.794679 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.795724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.796295 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.796793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.797853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:25.798371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:25.800042 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:25.810718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:25.826392 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 354/721] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:25.827403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.832674 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.833785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.834322 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.834795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] PATH_INFO: `/v3/services/image` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:25.835651 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:25.837405 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:25.851781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:25.852882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:50:25.853699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:25.856841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 368/722] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:25.862501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:25.946388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576bd8a-83ed-4775-b40e-c98dd4cef32a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.957420 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:25.974185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce04be6-4b44-4858-878c-a4e73171ca72 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:25.989039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:25.989986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:25.990412 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:25.990831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.073343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:26.079604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.081653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.148071 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.149254 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.149752 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.150300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.151218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] RBAC: Adding query filter params (name=image) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:26.151725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.153552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.159611 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 369/723] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:26.166826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.196707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 355/724] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:25 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:50:26.198003 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.278089 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a35a-8db1-45d9-8e8f-872acc04f283 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:26.306061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:26.311547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8487-e6b8-494d-b75b-d20a26b42a7a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:26.317410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.318299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.318729 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.319174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.320049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] RBAC: Adding query filter params (type=image) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:26.320505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.322236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.333333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 370/725] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:26.334421 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.350353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.351640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.352115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:26.353368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.354018 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.366939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.368997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:26.389242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:26.390245 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:26.391199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:26.391199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:26.391199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:26.391199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:26.397871 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 356/726] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:26.399074 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.446769 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098deed6-87d7-4cc7-9923-57d741f17de5 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:26.484029 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.484684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.484966 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.485242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.485996 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.487501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.511133 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d87b08-7b47-48cf-9622-7158d6e42556 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:26.520632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 371/727] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:50:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:26.567677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.568455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.568779 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.569059 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.569811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:26.570120 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.571714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.587210 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 357/728] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:26.593128 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.676984 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:26.716314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3863-3eda-452a-95e0-0b6e75113249 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:26.755918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.756785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.757026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.757292 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.764943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.766429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-81764718-2099-4cb1-8ec5-facfc2947231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:26.780929 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:26.781893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:26.782763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 372/729] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:26.790254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.805993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:26.838002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54be86-8f45-4374-a993-75b16b902a33 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.838521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54be86-8f45-4374-a993-75b16b902a33 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.838521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54be86-8f45-4374-a993-75b16b902a33 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.840104 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 373/730] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:26.845562 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.845832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.846109 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.863616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:26.864847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:26.907717 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725944c-6a3b-420d-bfc4-d29e70b787d4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:26.941146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 374/731] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:26 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:26.944478 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:26.945184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:26.945467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:26.945744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:26.946540 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:26.946846 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:26.948308 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:26.961080 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:26.962167 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 358/732] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:26.968112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.027748 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:27.062296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:27.075457 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ee8d9-4618-44cf-b1b1-9012fab8205d None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.111487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07fac7-4854-415e-9881-dd91f297c29a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.113277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.114127 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.114409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.114674 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.115331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.116934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:27.130697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:27.131767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:50:27.132644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:27.137201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 375/733] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:27.138758 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.267834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ce4b7-190f-483b-9d87-09b876e444f8 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.291283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.291946 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.292222 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.292489 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.293354 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=ee135c0b41e1474686678d60dc5018ca) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:27.293658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.295150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b841d8-c069-4401-9b32-922153f86f35 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.299398 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:27.312640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 359/734] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:50:26 2022] GET /identity/v3/role_assignments?user.id=ee135c0b41e1474686678d60dc5018ca&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=d384469b72f5485190c772f8974438e0 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:27.312640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f57d-7823-4331-8c20-570abb2167c7 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.312640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f57d-7823-4331-8c20-570abb2167c7 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.312640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f57d-7823-4331-8c20-570abb2167c7 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.312640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 360/735] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:27.312640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.313270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.313270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.323807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.324717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.325097 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.326211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.327086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:27.327807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.329423 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.331798 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:27.333112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:27.336139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 376/736] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jul 23 20:50:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:27.342039 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.410661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 361/737] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:27 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:27.436126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.463404 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565262-cb5a-4718-8d9c-826edf46cbeb None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.501505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:27.516291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.516527 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.516633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.516928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.517629 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:27.517932 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.519365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.530073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 377/738] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jul 23 20:50:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:27.531380 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.555591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf45c0-5dae-41de-99c0-3465d7c2fae3 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.602003 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:27.620166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.621100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.622070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.622219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] PATH_INFO: `/v3/services/network` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.623326 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.627029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:27.649736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:27.650780 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:50:27.651684 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:27.652402 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 362/739] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:27 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:27.664724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.676651 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cc4d8-0f74-4c05-9cdb-46137aa660b1 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.724000 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.724806 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.725082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.725514 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.726572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.727970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.754031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 378/740] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:50:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:27.793817 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909091-f7a1-4c4e-acfe-36342261f856 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.825007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:27.844281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:27.845060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:27.845343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:27.845619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:27.846414 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] RBAC: Adding query filter params (name=network) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:27.846778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:27.848289 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:27.854436 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 363/741] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:27.860308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:27.976200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ba869-cc1f-4536-9f13-efb88daa12c4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:27.985983 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:28.018235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:28.018908 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:28.019184 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:28.019454 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:28.020165 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] RBAC: Adding query filter params (type=network) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:28.020465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:28.021907 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61598-bfeb-4857-8c25-a4b510a96598 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:28.027539 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 379/742] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:28.033540 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:28.139822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03d4d-0bbe-439b-98a4-a34218d1dde4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:28.175212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71665d5-db69-45d7-b52e-fd94ea75f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:28.175876 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71665d5-db69-45d7-b52e-fd94ea75f00c None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:28.176163 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71665d5-db69-45d7-b52e-fd94ea75f00c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:28.176447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71665d5-db69-45d7-b52e-fd94ea75f00c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:28.177227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71665d5-db69-45d7-b52e-fd94ea75f00c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:28.178607 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71665d5-db69-45d7-b52e-fd94ea75f00c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:28.203685 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 364/743] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:50:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:50:28.928200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c427c9-fdb5-4157-8e57-9dc6ca11651b None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:28.928775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c427c9-fdb5-4157-8e57-9dc6ca11651b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:28.928775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c427c9-fdb5-4157-8e57-9dc6ca11651b None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:28.930283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 380/744] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:28.935438 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:28.935830 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:28.936001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:28.953081 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:28.954273 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:28.990212 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:29.036647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 365/745] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:28 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:29.058250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c427c9-fdb5-4157-8e57-9dc6ca11651b None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:29.188421 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c427c9-fdb5-4157-8e57-9dc6ca11651b None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:29.226318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:29.226975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:29.227252 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:29.227525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:29.283630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:29.326833 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:29.328400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:29.439981 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 381/746] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:50:29 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:50:29.441198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:29.552148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a65001-5f12-4462-bc8f-5bc07543f629 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:29.589283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:29.590107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:29.590342 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:29.590643 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:29.602970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:29.604485 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-028b5805-66cf-41ec-ae84-5cb7831366ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:50:29.624376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:29.625536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:29.626437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:50:29.626437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:50:29.626437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:50:29.626437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:29.626437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 366/747] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:29.632765 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:29.707352 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:29.753708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c04633-8705-4501-9708-d480adcbfcdc None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:29.754072 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c04633-8705-4501-9708-d480adcbfcdc None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:29.754236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c04633-8705-4501-9708-d480adcbfcdc None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:29.754779 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412adb-077c-4eb8-b2be-44377d051b58 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:29.755807 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 367/748] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:50:29.763587 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:29.764033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:29.764503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:29.785571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:29.786841 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:29.807381 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:29.813877 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:29.814590 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:29.814868 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:29.815137 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:29.815959 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:29.816264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:29.817718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:29.831470 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 382/749] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:29.890746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 368/750] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:29 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:29.915625 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:30.047164 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005e8b-95f3-4fa1-b0b9-bf08269440d7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:30.084882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:30.091595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:30.092439 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.092755 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.093026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.094273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:30.095146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0f8a4c02-f6e2-4650-aef9-8664e0b743b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:30.108804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:30.109822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:30.110883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 383/751] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Jul 23 20:50:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:30.118668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:30.168242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ff8b-dcf1-48d9-a3d1-e1974b5e1839 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.168564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ff8b-dcf1-48d9-a3d1-e1974b5e1839 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.168862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349ff8b-dcf1-48d9-a3d1-e1974b5e1839 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.170325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 384/752] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:30.179390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.179390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.179390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.198465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:30.199712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:30.253281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b37d7-ee24-439e-9f63-b17535de1d77 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:30.285442 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 385/753] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:30 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:30.290919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:30.291609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.291889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.292200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.292973 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:30.293281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:30.294713 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:30.300016 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 369/754] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jul 23 20:50:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:30.305986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:30.308703 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:30.325604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:30.419566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29103e28-28cf-4b7b-bc7d-4db6bec45826 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:30.424842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c26b-f760-4616-b6c9-6ba62c924a37 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:30.448629 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:30.458311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:30.458990 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.459266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.459526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.460282 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:30.460583 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:30.462127 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:30.463503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:30.464321 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.464629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.464897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.465551 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:30.467028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:30.467172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 386/755] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jul 23 20:50:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:30.479145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:30.480366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:30.482140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 370/756] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:30.486982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:30.623746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf642e-6d2b-4785-9d8e-00ac61c3231f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:30.662334 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:30.663314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.663955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.664232 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.664983 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:30.665295 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:30.666705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bf08-c6f6-4023-8f82-aefcad44051f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:30.672262 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 387/757] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:30.678453 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:30.765107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:30.791805 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd8a7-555e-43ed-87a4-67e08b60e7ba None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:30.828272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:30.828997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:30.829283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:30.829548 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:30.830260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:30.830563 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:30.831951 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780571f2-766c-453f-8d16-136facea8b6f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:30.838936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 371/758] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:32.733180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c9c67-5d00-49d4-9b54-7f9c46ea22f5 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:32.733739 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c9c67-5d00-49d4-9b54-7f9c46ea22f5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:32.733739 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c9c67-5d00-49d4-9b54-7f9c46ea22f5 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:32.735092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 388/759] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:32.740710 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab7033-6145-4712-a90c-99bf5e177548 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:32.741171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab7033-6145-4712-a90c-99bf5e177548 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:32.741399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab7033-6145-4712-a90c-99bf5e177548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:32.761293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-b5ab7033-6145-4712-a90c-99bf5e177548 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:32.762521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-b5ab7033-6145-4712-a90c-99bf5e177548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:32.839640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 372/760] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:32 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:32.863579 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c9c67-5d00-49d4-9b54-7f9c46ea22f5 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:32.931566 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:32.985528 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c9c67-5d00-49d4-9b54-7f9c46ea22f5 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:33.021586 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff209e5f-af2f-4748-97b2-b0aee974a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:33.022251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209e5f-af2f-4748-97b2-b0aee974a298 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:33.022542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209e5f-af2f-4748-97b2-b0aee974a298 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:33.022819 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209e5f-af2f-4748-97b2-b0aee974a298 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:33.023544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff209e5f-af2f-4748-97b2-b0aee974a298 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:33.024967 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff209e5f-af2f-4748-97b2-b0aee974a298 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:33.041337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 389/761] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:50:32 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:33.094173 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104dc84-2c69-4378-a08a-2c3686d6e916 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:33.094525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104dc84-2c69-4378-a08a-2c3686d6e916 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:33.094739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104dc84-2c69-4378-a08a-2c3686d6e916 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:33.096130 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 373/762] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:33.102228 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d9e9-6aeb-44c1-9f8b-dd15a9b8b6a4 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:33.102514 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d9e9-6aeb-44c1-9f8b-dd15a9b8b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:33.103595 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560d9e9-6aeb-44c1-9f8b-dd15a9b8b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:33.123907 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-9560d9e9-6aeb-44c1-9f8b-dd15a9b8b6a4 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:33.125202 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-9560d9e9-6aeb-44c1-9f8b-dd15a9b8b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:33.213574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 390/763] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:33 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:33.237966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104dc84-2c69-4378-a08a-2c3686d6e916 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:33.314771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:33.348529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104dc84-2c69-4378-a08a-2c3686d6e916 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:33.385336 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b520a-ccfd-42a6-8cd5-4e6396986146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:33.386012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b520a-ccfd-42a6-8cd5-4e6396986146 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:33.386284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b520a-ccfd-42a6-8cd5-4e6396986146 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:33.386556 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b520a-ccfd-42a6-8cd5-4e6396986146 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:33.387431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b520a-ccfd-42a6-8cd5-4e6396986146 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:33.388795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b520a-ccfd-42a6-8cd5-4e6396986146 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:33.405047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 374/764] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:50:33 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:35.295350 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645baea-3628-47a7-96b7-0c3a70b8a130 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.295925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645baea-3628-47a7-96b7-0c3a70b8a130 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.295925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645baea-3628-47a7-96b7-0c3a70b8a130 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.297461 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 391/765] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:35.302793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.303275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.303409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.321285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:35.322497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:35.398799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 375/766] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:35.423039 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645baea-3628-47a7-96b7-0c3a70b8a130 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:35.469354 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:35.538792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645baea-3628-47a7-96b7-0c3a70b8a130 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:35.575446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:35.576252 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.576526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.576823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.577471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:35.578832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-6e1fce3b-2b0a-462f-9dd3-2402cc728fb4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:35.591424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:35.592563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:35.593604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 392/767] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Jul 23 20:50:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:35.598809 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:35.654676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac0c2-3f26-41d7-bcfd-26176815f6b7 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.655003 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac0c2-3f26-41d7-bcfd-26176815f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.655258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac0c2-3f26-41d7-bcfd-26176815f6b7 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.655831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:35.656637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 393/768] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:35.662092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.662415 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.662644 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.679636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:35.680896 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:35.700148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6fe0-daff-4a98-abc4-556bb78952b5 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:35.735076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:35.735750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.736028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.736304 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.737050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:35.737362 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:35.738756 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:35.743415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 376/769] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jul 23 20:50:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:35.749272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:35.750337 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 394/770] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:35.773923 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:35.807606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:35.848785 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d215-0170-4ed3-b524-9e1950083c22 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:35.868779 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:35.874679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b15c-d3f2-435d-953e-4ad6f45a7b85 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:35.883342 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:35.884013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.884291 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.884564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.885369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:35.885652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:35.887003 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:35.892177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 377/771] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jul 23 20:50:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:35.898347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:35.910388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:35.911198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:35.911474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:35.911728 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:35.912375 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:35.914162 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:35.926214 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:35.927255 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:35.928297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 395/772] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:50:35.935443 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:35.999029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7702-f35e-4858-ab17-a486ce9bfc9d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:36.030480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:36.033247 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:36.033919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:36.034198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:36.034491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:36.034637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213af75-f488-4344-a912-a8351fc84115 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:36.035276 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] RBAC: Adding query filter params (interface=public, service_id=f4d9724b84ab45e08799fa2b3b640941, region_id=RegionOne) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:36.035583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:36.036990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:36.042648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 378/773] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:50:35 2022] GET /identity/v3/endpoints?service_id=f4d9724b84ab45e08799fa2b3b640941&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:36.048548 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:36.068940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:36.069538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:36.069818 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:36.070120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:36.070830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:36.071133 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:36.072711 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:36.078120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 396/774] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:36.083823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:36.098479 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:36.148997 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687c3eb-b409-45ab-996e-daa0906c8dd4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:36.188943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:36.189613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:36.189779 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a93f8a-2496-40dc-bfd3-b80eac04784d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:36.189899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:36.190152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:36.190829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:36.192197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:36.199969 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 379/775] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:50:36 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 20:50:36.227549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:36.228351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:36.228780 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:36.229059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:36.229790 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:36.230108 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:36.231609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:36.238064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 397/776] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:36.244256 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:36.357441 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503273d-2c54-49c7-b076-a2c81515f3ef None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:36.373007 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:36.407621 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:36.408310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:36.408591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:36.408967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:36.409773 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] RBAC: Adding query filter params (interface=public, service_id=3d45c698ecff461d9f27159e14ddb654, region_id=RegionOne) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:36.410093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:36.411483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc4e97-523d-4652-a4bf-2ea6b08d4ec5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:36.417846 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 380/777] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:50:36 2022] GET /identity/v3/endpoints?service_id=3d45c698ecff461d9f27159e14ddb654&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:36.423754 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:36.452506 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:36.529194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0384c28-ab5a-4840-a742-1d3f0db68d14 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:36.564839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85d4b8-a67a-4ba5-a0a0-0af2e7c36f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:36.565503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d4b8-a67a-4ba5-a0a0-0af2e7c36f60 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:36.565790 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d4b8-a67a-4ba5-a0a0-0af2e7c36f60 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:36.566065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d4b8-a67a-4ba5-a0a0-0af2e7c36f60 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:36.566754 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85d4b8-a67a-4ba5-a0a0-0af2e7c36f60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:36.568135 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85d4b8-a67a-4ba5-a0a0-0af2e7c36f60 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:36.574458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 398/778] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:50:36 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:50:38.453954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9177164-23cd-4666-b004-ec1a744aa1ee None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:38.454538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9177164-23cd-4666-b004-ec1a744aa1ee None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:38.454538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9177164-23cd-4666-b004-ec1a744aa1ee None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:38.455934 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 381/779] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:38.461371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:38.461831 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:38.461931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:38.479591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:38.480825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:38.551438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 399/780] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:38.576205 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9177164-23cd-4666-b004-ec1a744aa1ee None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:38.690689 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9177164-23cd-4666-b004-ec1a744aa1ee None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:38.726175 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:38.726986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:38.727259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:38.727523 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:38.728147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:38.729544 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-d0a5dded-ed89-4569-9a20-955ec7c8045d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:38.741676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:38.742646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:38.743578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 382/781] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Jul 23 20:50:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:38.749242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:38.771956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:38.820944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243bea-4775-4e10-932c-6dbfbe161b48 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:38.821160 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243bea-4775-4e10-932c-6dbfbe161b48 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:38.821378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b243bea-4775-4e10-932c-6dbfbe161b48 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:38.822731 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 383/782] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:38.827917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:38.828189 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:38.828457 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:38.845939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:38.847163 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:38.854360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b87f6-9aa9-42bd-8d43-90d5413a2866 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:38.884196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:38.889603 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:38.890275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:38.890552 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:38.890828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:38.891537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:38.891843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:38.893259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:38.898128 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 400/783] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jul 23 20:50:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:38.903792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:38.923762 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 384/784] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:38.947720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:38.989277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:39.005504 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19049f9-769b-4c4f-9453-e2b09985ecd6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:39.052276 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:39.053524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:39.054059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:39.054591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:39.055218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aaeb5-1f46-4243-8027-531f4955a452 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:39.055979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:39.056625 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:39.058889 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:39.066652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 401/785] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jul 23 20:50:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:39.072582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:39.094705 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:39.095518 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:39.095807 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:39.096080 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:39.096836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:39.098224 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:39.110125 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:39.111164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:39.111989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 385/786] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:39.117259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:39.151196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:39.171246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b9f5-77cd-4ff0-a779-aa9f51995789 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:39.208508 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:39.209200 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:39.209484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:39.209761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:39.210508 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:39.212008 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:39.221086 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e19a-5fe4-40aa-ae76-3728e39c53e1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:39.231014 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 402/787] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:50:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:39.270581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:39.271264 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:39.271550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:39.271824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:39.272543 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:39.272890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:39.274322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:39.285087 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 386/788] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:39.286277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:39.290928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:39.397637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49206aed-5aa5-4602-a7db-c3e305bfb553 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:39.432622 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:39.433303 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:39.433570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:39.433842 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:39.434627 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:39.434931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:39.436306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5723028-8c87-4c65-ba62-e47b002a0b26 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:39.441354 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 403/789] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jul 23 20:50:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:39.447486 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:39.544908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:39.552637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c6ad-5199-4dcb-8134-7cb6875f88c4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:39.587875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367c56c-7559-47e8-a681-ee53523dca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:39.588539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367c56c-7559-47e8-a681-ee53523dca90 None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:39.588852 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367c56c-7559-47e8-a681-ee53523dca90 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:39.589126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367c56c-7559-47e8-a681-ee53523dca90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:39.589868 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367c56c-7559-47e8-a681-ee53523dca90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:39.591275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367c56c-7559-47e8-a681-ee53523dca90 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:39.610817 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 387/790] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:50:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:50:41.492466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9810-9eda-4ea3-81b6-f62c6fb73189 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:41.493031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9810-9eda-4ea3-81b6-f62c6fb73189 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:41.493140 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9810-9eda-4ea3-81b6-f62c6fb73189 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:41.494455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 404/791] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:41.500176 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:41.500682 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:41.500682 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:41.518691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:41.519882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:41.592011 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 388/792] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:41.615394 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9810-9eda-4ea3-81b6-f62c6fb73189 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:41.683849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:41.721527 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9810-9eda-4ea3-81b6-f62c6fb73189 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:41.756770 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:41.757590 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:41.757866 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:41.758129 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] PATH_INFO: `/v3/services/compute` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:41.758781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:41.760167 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-3745b425-20eb-4274-8e85-0b50c45430bd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:41.776593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:41.777678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:41.778525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 405/793] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:41.784025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:41.867856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:41.870332 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31d948-a2e7-4eea-9a25-c0cd4a2504d0 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:41.870604 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31d948-a2e7-4eea-9a25-c0cd4a2504d0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:41.870875 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31d948-a2e7-4eea-9a25-c0cd4a2504d0 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:41.872319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 406/794] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:41.877318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc468d-215e-48db-a230-98650d861a36 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:41.877612 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc468d-215e-48db-a230-98650d861a36 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:41.877944 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc468d-215e-48db-a230-98650d861a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:41.893520 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca119b3-a5d6-4962-93eb-21eeddc84d10 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:41.895685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-56cc468d-215e-48db-a230-98650d861a36 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:41.896924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-56cc468d-215e-48db-a230-98650d861a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:41.930322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:41.930995 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:41.931276 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:41.931550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:41.932257 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:41.932562 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:41.933980 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:41.938762 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 389/795] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:41.944461 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:41.965876 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 407/796] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:50:41.990938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc468d-215e-48db-a230-98650d861a36 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:42.046194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13acd8-f281-4c6f-8a27-40db59b1e43f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:42.053429 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:42.081415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:42.082091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:42.082372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:42.082645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:42.083398 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] RBAC: Adding query filter params (type=compute) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:42.083705 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:42.085187 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:42.090649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 390/797] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:50:42.093789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc468d-215e-48db-a230-98650d861a36 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:42.134375 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:42.135095 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:42.135376 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:42.135648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:42.136363 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:42.137931 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:42.139364 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING keystone.server.flask.common [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 23 20:50:42.160925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.sql.core [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 23 20:50:42.160925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 20:50:42.160925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [parameters: {'id': '1e859be3236d471bb0b78c936a7fdf64', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 23 20:50:42.160925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e859be3236d471bb0b78c936a7fdf64.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e859be3236d471bb0b78c936a7fdf64. Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:50:42.178520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result.read() Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 23 20:50:42.179530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application yield resource Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise self.value Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application session.commit() Jul 23 20:50:42.180524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.session.flush() Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application compat.raise_( Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 20:50:42.181772 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 20:50:42.183360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result.read() Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:50:42.184756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [parameters: {'id': '1e859be3236d471bb0b78c936a7fdf64', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:42.186070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:42.187060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e859be3236d471bb0b78c936a7fdf64. Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:42.188160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 408/798] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Jul 23 20:50:41 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:42.188896 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:42.193002 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:42.312875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf540-52e9-48f5-86a1-52ba91d3c96c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:42.346378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:42.347184 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:42.347463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:42.347732 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:42.354365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:42.355824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-56c5f488-d995-4f8d-9407-ba399ee36726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:50:42.369714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:42.370670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:42.371673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 391/799] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:42.377215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:42.482477 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e25ce2-19f8-443e-8143-9182ce29867f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:42.500428 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:42.520236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:42.520934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:42.521216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:42.521486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:42.522238 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:42.522545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:42.524196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff92552-5010-4c48-8a56-9b3772419ed2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:42.545213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 409/800] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:44.374596 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f053-044b-404b-a9c3-e378a00b2226 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:44.375156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f053-044b-404b-a9c3-e378a00b2226 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:44.375156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f053-044b-404b-a9c3-e378a00b2226 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:44.376517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 392/801] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:44.382212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4b9f-e9d5-44a9-b99b-0ded84087743 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:44.382683 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4b9f-e9d5-44a9-b99b-0ded84087743 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:44.382850 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4b9f-e9d5-44a9-b99b-0ded84087743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:44.401119 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-bd8e4b9f-e9d5-44a9-b99b-0ded84087743 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:44.402617 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-bd8e4b9f-e9d5-44a9-b99b-0ded84087743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:44.478460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 410/802] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:44.507807 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f053-044b-404b-a9c3-e378a00b2226 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:44.576751 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:44.620301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f053-044b-404b-a9c3-e378a00b2226 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:44.659161 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2ef70-967d-47f2-97b6-663e3fa8e25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:44.659822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2ef70-967d-47f2-97b6-663e3fa8e25e None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:44.660109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2ef70-967d-47f2-97b6-663e3fa8e25e None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:44.660378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2ef70-967d-47f2-97b6-663e3fa8e25e None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:44.661138 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2ef70-967d-47f2-97b6-663e3fa8e25e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:44.662559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2ef70-967d-47f2-97b6-663e3fa8e25e None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:44.678432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 393/803] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:50:44 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:50:44.796314 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adc2e0-4018-477d-80e0-c86e433ba544 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:44.796741 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adc2e0-4018-477d-80e0-c86e433ba544 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:44.797087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adc2e0-4018-477d-80e0-c86e433ba544 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:44.798677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 411/804] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:44.805088 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:44.805311 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:44.805625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:44.824560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:44.825931 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:44.906240 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 394/805] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:44 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:44.932428 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adc2e0-4018-477d-80e0-c86e433ba544 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:45.044084 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adc2e0-4018-477d-80e0-c86e433ba544 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:45.054068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:45.080316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:45.081036 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:45.081363 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:45.081633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:45.082369 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:45.083792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:45.097960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.sql.core [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 23 20:50:45.097960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 23 20:50:45.097960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [parameters: {'user_id': '2514ab0473c442068f721011214edb64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 23 20:50:45.097960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result.read() Jul 23 20:50:45.105451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:50:45.106458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application yield resource Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise self.value Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application session.commit() Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 20:50:45.107624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.session.flush() Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application compat.raise_( Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 20:50:45.108793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:50:45.109676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application result.read() Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:50:45.110507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [parameters: {'user_id': '2514ab0473c442068f721011214edb64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:45.111339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 23 20:50:45.113310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:45.114507 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 412/806] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jul 23 20:50:44 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:45.115168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:45.169504 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:45.224056 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d69a93-8a91-4f1d-a70e-288db39db69b None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:45.262976 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:45.263791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:45.264076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:45.264348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:45.271981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:45.273464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-2021d5f3-0f67-4512-ab6c-5b3abddb6539 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:50:45.288855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:45.289905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:45.290949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 395/807] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:50:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:45.296645 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:45.406036 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db3bd-e937-438f-9c0b-dc5a914059e4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:45.442788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:45.443464 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:45.443746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:45.444024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:45.444861 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:45.445163 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:45.446816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded5612-108c-480b-b1ba-b05afdcedd4d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:45.485007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 413/808] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jul 23 20:50:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:46.925171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c367b6-c431-4276-93e8-bb02f9bbe929 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:46.925739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c367b6-c431-4276-93e8-bb02f9bbe929 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:46.925739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c367b6-c431-4276-93e8-bb02f9bbe929 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:46.927078 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 396/809] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:46.932505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244af77e-afc8-4516-a262-e06f30d902af None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:46.932970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244af77e-afc8-4516-a262-e06f30d902af None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:46.933087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244af77e-afc8-4516-a262-e06f30d902af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:46.951430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-244af77e-afc8-4516-a262-e06f30d902af None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:46.953044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-244af77e-afc8-4516-a262-e06f30d902af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:46.977141 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:47.025199 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 414/810] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:46 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:47.049902 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c367b6-c431-4276-93e8-bb02f9bbe929 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:47.157834 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c367b6-c431-4276-93e8-bb02f9bbe929 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:47.168966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:47.196268 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:47.197038 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:47.197314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:47.197582 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:47.198236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:47.199624 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:47.211467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:47.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:50:47.213671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 397/811] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:47.219022 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244af77e-afc8-4516-a262-e06f30d902af None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:47.348325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244af77e-afc8-4516-a262-e06f30d902af None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:47.381202 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:47.381865 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:47.382148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:47.382421 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:47.383130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] RBAC: Adding query filter params (name=compute) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:47.383430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:47.384848 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:47.389602 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 415/812] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:47.395757 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:47.500050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a857da-8362-4634-b924-57f45b4de9d4 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:47.535700 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:47.536367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:47.536645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:47.536947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:47.537644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] RBAC: Adding query filter params (type=compute) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:47.537946 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:47.539683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:47.544730 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 398/813] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:47.551222 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:47.578297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:47.661619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11147-4414-4ca9-9057-e261a443fa3c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:47.698501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:47.699157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:47.699436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:47.699712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:47.700525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] RBAC: Adding query filter params (interface=public, service_id=01f07d3e659f4087ad38d6c53f0a8e7b, region_id=RegionOne) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:47.700870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:47.702261 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d4e5-3674-4dd7-a8dd-85fdab7c98e0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:47.707492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 416/814] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:50:47 2022] GET /identity/v3/endpoints?service_id=01f07d3e659f4087ad38d6c53f0a8e7b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:47.713475 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:47.758617 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:47.821779 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb955044-d584-48a1-b5ce-7f78f5821e4d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:47.856404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fefa3-b1fc-479f-b0df-f9d89f0206a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:47.857097 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fefa3-b1fc-479f-b0df-f9d89f0206a7 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:47.857384 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fefa3-b1fc-479f-b0df-f9d89f0206a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:47.857658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fefa3-b1fc-479f-b0df-f9d89f0206a7 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:47.858340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fefa3-b1fc-479f-b0df-f9d89f0206a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:47.859763 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fefa3-b1fc-479f-b0df-f9d89f0206a7 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:47.866141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 399/815] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:50:47 2022] GET /identity/v3/services => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:50:50.089427 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb72d8-99ea-465d-b393-6f7d50ab7ca8 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:50.090058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb72d8-99ea-465d-b393-6f7d50ab7ca8 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:50.090058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb72d8-99ea-465d-b393-6f7d50ab7ca8 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:50.091386 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 417/816] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:50:50.097420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:50.097947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:50.098059 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:50.115582 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:50:50.116928 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:50:50.190738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 400/817] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:50:50 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:50:50.215252 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb72d8-99ea-465d-b393-6f7d50ab7ca8 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:50.314864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:50.336753 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb72d8-99ea-465d-b393-6f7d50ab7ca8 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:50.375306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:50.376028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:50.376312 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:50.376584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] PATH_INFO: `/v3/services/compute` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:50.377303 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:50.378737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:50:50.391796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:50:50.393166 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:50:50.394291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 418/818] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:50:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:50:50.400362 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:50.446126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:50.527388 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ec767-a79f-4e32-9cf0-3ce725a0809d None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:50.563558 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:50.564208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:50.564489 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:50.564800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:50.565505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:50.565814 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:50.567186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:50.572109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 401/819] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:50.580889 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:50.689879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7ba33-dbcc-4bd9-a6d6-ae36fdc3598c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:50.728958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:50.729617 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:50.729896 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:50.730152 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:50.730858 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:50:50.731186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:50.732578 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36e753-841c-46e1-ba06-c154a2ed34c2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:50.737640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 419/820] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jul 23 20:50:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:50:50.747221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:50:50.850231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:50:50.858065 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db5514-8763-431c-9353-6b5caea89ae5 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:50:50.894518 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f911ed3-6cbc-4f33-8c7a-d0f13b7afe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:50:50.895172 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f911ed3-6cbc-4f33-8c7a-d0f13b7afe3b None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:50:50.895455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f911ed3-6cbc-4f33-8c7a-d0f13b7afe3b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:50:50.895709 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f911ed3-6cbc-4f33-8c7a-d0f13b7afe3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:50:50.896446 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f911ed3-6cbc-4f33-8c7a-d0f13b7afe3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:50:50.897859 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f911ed3-6cbc-4f33-8c7a-d0f13b7afe3b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:50:50.918285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 402/821] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:50:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:51:00.734951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=93 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:00.913959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=23,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:52.960335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850dcd-1366-42fb-a999-cebb1e111146 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:52.960989 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850dcd-1366-42fb-a999-cebb1e111146 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:52.960989 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850dcd-1366-42fb-a999-cebb1e111146 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:52.962756 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 420/822] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:51:52.968956 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:52.969487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:52.969487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:52.990517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:51:52.991776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:51:53.082884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 403/823] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:51:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:51:53.109435 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850dcd-1366-42fb-a999-cebb1e111146 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:53.267218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850dcd-1366-42fb-a999-cebb1e111146 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:53.320764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:53.321761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:53.322057 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:53.322288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:53.334310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:53.335857 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:51:53.357898 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:51:53.359218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:51:53.360706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:51:53.360706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:51:53.360706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:51:53.360706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:51:53.360706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 421/824] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:51:53.365675 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:53.505061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a2143-9c0f-4840-8a53-6f1a6d4ac302 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:53.539391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:53.557170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:53.557948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:53.558293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:53.558644 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:53.559754 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:53.560101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:53.561611 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e202e-e055-4f06-9a4b-c5cab24fe98a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:53.594941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 404/825] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:51:53.602551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:53.686795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:53.747463 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21b4f8-7884-497c-aa44-c1bca9697cbc None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:53.789549 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902582d-be85-4119-a66f-63a53cb294a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:53.790283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902582d-be85-4119-a66f-63a53cb294a1 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:53.790564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902582d-be85-4119-a66f-63a53cb294a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:53.790837 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902582d-be85-4119-a66f-63a53cb294a1 None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:53.791553 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902582d-be85-4119-a66f-63a53cb294a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:53.793057 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902582d-be85-4119-a66f-63a53cb294a1 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:53.815823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 422/826] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jul 23 20:51:53 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:51:56.279888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396db1a-283c-4ab1-9e53-fe27e1a6ba71 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:56.280476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396db1a-283c-4ab1-9e53-fe27e1a6ba71 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:56.280581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396db1a-283c-4ab1-9e53-fe27e1a6ba71 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:56.282211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 405/827] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:51:56.288733 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:56.289206 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:56.289316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:56.307613 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:51:56.309105 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:51:56.381509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 423/828] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:51:56 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:51:56.409641 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396db1a-283c-4ab1-9e53-fe27e1a6ba71 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:56.524278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396db1a-283c-4ab1-9e53-fe27e1a6ba71 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:56.562164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:56.563105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:56.563393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:56.563662 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:56.576849 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:51:56.585527 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:51:56.587503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:51:56.589186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 406/829] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:51:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:51:56.594743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:56.642467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:56.711001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ec1f-e97f-417c-af53-a75f9b867df8 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:56.747058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:56.747737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:56.748020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:56.748299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:56.749173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:56.749488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:56.750985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:56.765121 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 424/830] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:51:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:51:56.766689 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:56.826274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:56.892746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77fd9-e4a9-4f21-9ada-54cdf90d4f70 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:56.936085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:56.936937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:56.937223 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:56.937522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:56.949170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:56.950724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:51:56.969347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:51:56.970468 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:51:56.971374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:51:56.971374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:51:56.971374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:51:56.971374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:51:56.971374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 407/831] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:51:56.977782 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:57.085997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:57.089082 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce0d02-22ac-4cc4-aba7-e2d1fbde4fa4 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:57.125652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:57.126452 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:57.126887 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:57.127246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:57.127968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:57.128700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:57.130284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:57.145497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 425/832] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:51:57.153471 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:57.269146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:57.274082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a327bb-077d-4c76-8e6a-833ee67edfad None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:57.310197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:57.311041 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:57.311318 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:57.311588 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:57.320036 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:57.321651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:51:57.338990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:51:57.340152 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:51:57.341397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:51:57.345806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 408/833] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:51:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:51:57.346908 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:57.461025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3dc6e-173e-45e7-ba91-e7dd25cc6e58 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:57.501161 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:57.501955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:57.502269 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:57.502577 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:57.503576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:57.503982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:57.505554 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:57.531822 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 426/834] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jul 23 20:51:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:51:57.533776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:57.648691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdef4b-9a85-4c68-aa6e-59ee1ca43ba3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:57.686538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:57.687268 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:57.687619 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:57.687922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:57.720442 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:57.765926 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:57.767393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:57.871052 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 409/835] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:51:57 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:51:57.877561 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:57.901170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:58.015618 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebbc7d-f770-4b54-a8a8-43d241d1e42a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:58.058411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:58.059323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:58.059603 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:58.059922 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:58.070677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:58.072133 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:51:58.090955 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:51:58.093116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:51:58.094242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:51:58.094242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:51:58.094242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:51:58.094242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:51:58.094242 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 427/836] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:51:58.098404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:58.165824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:58.216912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8d589-f285-4f1a-a7fc-67bf341e6f84 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:58.263814 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:58.264501 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:58.264824 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:58.265270 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:58.266037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:58.266339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:58.267791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:58.286571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 410/837] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:51:58.288275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:58.371450 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:58.405559 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a939-0029-4cee-bdc0-80b7db4b4ba0 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:58.440498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:58.441241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:58.441525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:58.441799 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:58.448691 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:58.450220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:51:58.463824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:51:58.465151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:51:58.466371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 428/838] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:51:58.471860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:58.582568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bdfbf-147c-4720-9416-e95173e17b9c None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:58.602353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:58.621014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:58.621888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:58.622254 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:58.622539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:58.623421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:58.623775 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:58.625503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1734686-bdd3-4b9e-98d8-423ead38ff68 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:58.639978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 411/839] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:51:58.646249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:51:58.754171 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e90a9-401e-485b-a814-0faf202200c6 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:51:58.785067 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:51:58.792181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:51:58.792964 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:51:58.793158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:51:58.793432 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:51:58.794258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=74b7c0b2078f4349bdf2fbb717fc7d93) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:51:58.794569 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:51:58.796006 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7e7c-c386-4ea1-8d14-1e9812076c33 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:51:58.802336 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 429/840] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:51:58 2022] GET /identity/v3/role_assignments?user.id=74b7c0b2078f4349bdf2fbb717fc7d93&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:01.133540 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57d8db-025a-4d93-9c1b-2cf553e6be97 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:01.134110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57d8db-025a-4d93-9c1b-2cf553e6be97 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:01.134110 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57d8db-025a-4d93-9c1b-2cf553e6be97 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:01.135649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 412/841] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:01.141263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:01.141745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:01.141838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:01.162197 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:01.163574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:01.242987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 430/842] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:01.269958 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57d8db-025a-4d93-9c1b-2cf553e6be97 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:01.391512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57d8db-025a-4d93-9c1b-2cf553e6be97 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:01.432235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:01.433068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:01.433379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:01.433702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:01.446661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:52:01.454651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:01.455683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:01.456535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 413/843] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:52:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:01.462157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:01.570525 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84113b-c772-4f46-8b63-4a7553ae5e3f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:01.596807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:01.607951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:01.608662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:01.608948 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:01.609252 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:01.609972 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] RBAC: Adding query filter params (name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:01.610278 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:01.611668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:01.620808 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 431/844] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:01.627017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:01.674367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:01.750016 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63127a-0599-40d5-9b00-2216ee2ec9ff None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:01.789101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:01.790071 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:01.790389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:01.790664 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:01.806347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:01.808594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:01.831077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:01.832201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:01.838159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:01.838159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:01.838159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:01.838159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:01.838159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 414/845] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:01.838887 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:01.967643 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3633-3594-4214-a6bf-79b862efcbdb None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:02.009829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:02.010531 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:02.010811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:02.011086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:02.011828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:02.012244 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:02.013720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:02.027771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 432/846] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:52:02.033666 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:02.177805 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:02.189292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b6937-91b9-4a93-a703-cd948afb6644 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:02.229958 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:02.230787 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:02.231102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:02.231454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:02.241357 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:02.243034 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:52:02.261307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:02.263339 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:02.265196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 415/847] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:02.269975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:02.322037 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:02.389678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404810c-377b-479f-9009-09d70031ee8b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:02.430430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:02.431236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:02.431580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:02.431912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:02.432847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:02.433246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:02.434904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:02.458754 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 433/848] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jul 23 20:52:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:02.464916 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:02.570322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff2d39-99b5-465a-8e59-937bc06c20c3 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:02.606437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:02.607410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:02.607823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:02.608219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:02.620338 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:02.621908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:02.640409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:02.641594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:02.642612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:02.642612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:02.642612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:02.642612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:02.642612 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 416/849] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:52:02.647608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:02.762534 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d30b-1dbe-429e-8e44-ac70cd86810f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:02.766684 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:02.810122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:02.811154 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:02.811436 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:02.811789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:02.812928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:02.813398 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:02.815147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:02.829431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 434/850] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:02.836534 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:02.840151 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:02.970322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266cbb-efd1-4aaf-a7ac-4a91eaa301d1 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:03.015508 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:03.016477 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:03.016796 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:03.017075 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:03.024881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:03.026585 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:52:03.043845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:03.045028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:03.046648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 417/851] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:52:03.052212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:03.165941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c371a7-bb12-44be-aa6b-14c0defd773d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:03.206234 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:03.206913 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:03.207195 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:03.207476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:03.208274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:03.208625 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:03.210306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c9315-9a6d-4870-9e68-c0e47971ebe0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:03.223034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 435/852] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:03.229289 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:03.300723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:03.355367 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f73d8-d557-430d-a719-427584b2d375 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:03.400594 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62c1b-b2fe-43bd-a3d5-b4eadcb40712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:03.401984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62c1b-b2fe-43bd-a3d5-b4eadcb40712 None admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:03.402264 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62c1b-b2fe-43bd-a3d5-b4eadcb40712 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:03.402598 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62c1b-b2fe-43bd-a3d5-b4eadcb40712 None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/74b7c0b2078f4349bdf2fbb717fc7d93/roles/6e6f08ddea5b4aabbf786138db459d6a` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:03.421281 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62c1b-b2fe-43bd-a3d5-b4eadcb40712 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=74b7c0b2078f4349bdf2fbb717fc7d93, role_id=6e6f08ddea5b4aabbf786138db459d6a)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:03.423047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62c1b-b2fe-43bd-a3d5-b4eadcb40712 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:03.438195 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 418/853] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:52:03 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/74b7c0b2078f4349bdf2fbb717fc7d93/roles/6e6f08ddea5b4aabbf786138db459d6a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:52:05.912524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9adb2a-8a1c-4d56-82f0-c160b21f256c None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:05.913241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9adb2a-8a1c-4d56-82f0-c160b21f256c None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:05.913241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9adb2a-8a1c-4d56-82f0-c160b21f256c None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:05.915418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 436/854] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:05.922732 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:05.923211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:05.923314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:05.944723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:05.946884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:06.024986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 419/855] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:06.051354 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9adb2a-8a1c-4d56-82f0-c160b21f256c None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:06.077442 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:06.164486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9adb2a-8a1c-4d56-82f0-c160b21f256c None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:06.204290 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:06.205310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:06.205591 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:06.205916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:06.218346 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:52:06.226518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:06.227722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:06.228565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 437/856] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jul 23 20:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:06.234482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:06.285420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:06.353586 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77028-e967-4039-9a76-c27dbd7d0e6b None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:06.389677 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:06.390657 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:06.390936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:06.391384 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:06.392382 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] RBAC: Adding query filter params (name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:06.392856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:06.394754 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:06.404260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 420/857] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jul 23 20:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:06.410862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:06.512743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:06.530743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4329b8-18ab-4dd4-8f99-c13035abdf4a None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:06.567091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:06.567960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:06.568259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:06.568561 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:06.579669 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:06.581181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:06.598916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:06.600054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:06.601040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:06.601040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:06.601040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:06.601040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:06.601040 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 438/858] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:06.606499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:06.719926 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159da6f2-c32f-4304-b431-ea82feb5c7dd None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:06.722708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:06.760293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:06.761044 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:06.761328 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:06.761604 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:06.762868 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:06.763167 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:06.764755 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:06.780708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 421/859] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:06.784780 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:06.901609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ad70d-b91b-45a2-b481-a5ba9623d5d2 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:06.944322 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:06.945434 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:06.945844 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:06.946126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:06.950913 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:06.957361 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:06.959288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:52:06.978007 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:06.980486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:06.983619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 439/860] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:06.985536 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:07.102686 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1dc73-33be-44b8-a310-b7bfeb8f4b1a None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:07.141517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:07.142265 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:07.142483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:07.142880 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:07.143642 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:07.143916 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:07.145380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:07.162962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 422/861] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jul 23 20:52:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:07.169104 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:07.298678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cef5-bd70-4e07-9bee-02c6485520ac None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:07.339988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:07.340807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:07.341120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:07.341395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:07.408308 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:07.416590 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:07.418282 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:07.530920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 440/862] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:52:07 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:52:07.538175 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:07.569492 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:07.665917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5e92-767d-4ea6-942c-60f2613ae0cd None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:07.705637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:07.706590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:07.706875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:07.707148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:07.719385 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:07.721231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:07.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:07.742421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:07.743823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:07.743823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:07.743823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:07.743823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:07.743823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 423/863] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:07.748738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:07.860211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:07.867262 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b580f52-327a-454f-8c41-0aaca24a99c7 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:07.913376 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:07.913999 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:07.914320 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:07.914548 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:07.915272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:07.915572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:07.917083 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:07.929757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 441/864] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:52:07.935881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:08.019788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:08.051659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312110-33db-45f5-a36c-decad0829b69 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:08.089590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:08.090432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:08.090711 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:08.090985 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:08.098057 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:08.099509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:52:08.114945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:08.115897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:08.116863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 424/865] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:08.122410 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:08.248506 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7df70-1c20-4579-9ab2-986a751c3a8e None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:08.291406 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:08.292178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:08.292464 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:08.292840 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:08.293804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:08.294186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:08.295690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8942aa-4be9-413a-9211-b24ebfda8b9b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:08.309897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 442/866] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:52:08.320657 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:08.439131 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938703-a1c0-4d53-92ba-d43f6a1a4931 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:08.476884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:08.477577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:08.477936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:08.478180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:08.479101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] RBAC: Adding query filter params (role.id=6e6f08ddea5b4aabbf786138db459d6a, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=74b7c0b2078f4349bdf2fbb717fc7d93) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:08.479415 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:08.480877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c1ea2-0040-446f-86cb-592cbe6ff15c None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:08.482832 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:08.497678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 425/867] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:52:08 2022] GET /identity/v3/role_assignments?user.id=74b7c0b2078f4349bdf2fbb717fc7d93&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=6e6f08ddea5b4aabbf786138db459d6a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:52:10.863558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302321-7a40-4b97-8a0a-a708c9cf264f None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:10.864325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302321-7a40-4b97-8a0a-a708c9cf264f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:10.864325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302321-7a40-4b97-8a0a-a708c9cf264f None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:10.865847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 443/868] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:10.871242 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:10.871698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:10.871785 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:10.889833 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:10.891357 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:10.984475 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 426/869] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:11.015665 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302321-7a40-4b97-8a0a-a708c9cf264f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:11.036674 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:11.136246 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302321-7a40-4b97-8a0a-a708c9cf264f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:11.174573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:11.175387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:11.175661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:11.175924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:11.189060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:52:11.197178 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:11.198636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:11.199816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 444/870] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:11.205119 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:11.331199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78c81-8c3d-4e58-a823-6002e46e5217 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:11.362795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:11.372220 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:11.372945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:11.373222 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:11.373494 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:11.374246 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:11.374547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:11.375930 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:11.385273 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 427/871] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:52:11.392325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:11.481670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:11.507376 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c85a-aa6d-4c41-aac5-5dab0bf9e80c None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:11.546321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:11.547340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:11.547635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:11.548068 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:11.560382 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:11.562239 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:11.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:11.583796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:11.584784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:11.584784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:11.584784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:11.584784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:11.584784 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 445/872] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:52:11.591470 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:11.711000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cc559-f9f0-433c-9f84-f848b4725f0f None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:11.755683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:11.756507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:11.756855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:11.757165 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:11.758068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:11.758426 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:11.759846 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:11.772818 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 428/873] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:11.778619 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:11.888565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6c3d0-0532-4df7-bd96-48280bc61962 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:11.922670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:11.932424 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:11.933332 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:11.933670 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:11.933986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:11.943695 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:11.945392 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:52:11.965309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:11.966672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:11.967648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 446/874] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:11.974159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:12.037800 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:12.093516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d667d-dec8-4e56-9bff-df5f1c4458b0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:12.134738 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:12.135421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:12.135704 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:12.135979 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:12.136978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:12.137491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:12.139077 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:12.158108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 429/875] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jul 23 20:52:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:12.164639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:12.288216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce9b6b-f3ec-46b3-a25c-66fb18122673 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:12.323064 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:12.323708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:12.323982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:12.324316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:12.388798 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:12.402582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:12.404057 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:12.514464 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 447/876] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:52:12 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:52:12.520802 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:12.630572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e53c4-9e2c-43f1-8a35-f2f80b1d55f0 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:12.641444 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:12.676019 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:12.677139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:12.677422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:12.677697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:12.692154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:12.693676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:12.714064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:12.715284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:12.716232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:12.716232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:12.716232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:12.716232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:12.716232 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 430/877] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:12.721766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:12.815400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:12.829055 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edb156-ece2-4519-a008-9a5cda9b2d62 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:12.866838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:12.867512 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:12.867792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:12.868044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:12.868878 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:12.869185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:12.870633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:12.884509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 448/878] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:12.892154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:13.019165 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75665c4e-01db-41e4-ab58-6e60eb689dbf None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:13.057086 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:13.057903 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:13.058169 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:13.058442 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:13.066703 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:13.068093 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:52:13.083721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:13.084897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:13.085810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 431/879] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:13.091380 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:13.201960 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1a951-c438-4691-b9f4-f17554835958 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:13.236100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:13.236823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:13.237102 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:13.237374 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:13.238185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:13.238582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:13.239997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4a270-c18b-4deb-bf61-35ee45ecb301 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:13.254599 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 449/880] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:13.261596 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:13.289930 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:13.372442 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91f7f9-4d4a-44cc-8119-2f8b9c4b85d2 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:13.406067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:13.406723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:13.406996 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:13.407260 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:13.408078 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=74b7c0b2078f4349bdf2fbb717fc7d93) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:13.408379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:13.409847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102a00-c519-4932-9ba9-ee6b85123848 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:13.415782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 432/881] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:52:13 2022] GET /identity/v3/role_assignments?user.id=74b7c0b2078f4349bdf2fbb717fc7d93&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=d384469b72f5485190c772f8974438e0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:15.670623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022fc8d-fb2a-4663-9eac-e5891a3add0f None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:15.671216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022fc8d-fb2a-4663-9eac-e5891a3add0f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:15.671216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022fc8d-fb2a-4663-9eac-e5891a3add0f None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:15.672572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 450/882] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:15.677907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:15.678349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:15.678450 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:15.695847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:15.697101 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:15.766584 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 433/883] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:15.791449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022fc8d-fb2a-4663-9eac-e5891a3add0f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:15.803105 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:15.902924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022fc8d-fb2a-4663-9eac-e5891a3add0f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:15.946600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:15.947317 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:15.947592 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:15.947902 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:15.959558 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:52:15.968065 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:15.969215 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:15.970056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 451/884] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:52:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:15.976087 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:15.992222 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:16.079198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ea2a-b65e-450a-9009-3d25ee9c371b None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:16.114629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:16.115298 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:16.115576 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:16.115861 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:16.116637 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:16.116944 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:16.118327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:16.126947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 434/885] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:52:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:16.133067 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:16.206928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:16.242580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c7eb-d66a-47bc-92a7-be4fe6669045 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:16.279988 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119abe-285f-44c5-a183-24817640a820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:16.280841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119abe-285f-44c5-a183-24817640a820 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:16.281120 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119abe-285f-44c5-a183-24817640a820 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:16.281397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119abe-285f-44c5-a183-24817640a820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:16.293608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119abe-285f-44c5-a183-24817640a820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:16.295170 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119abe-285f-44c5-a183-24817640a820 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-05119abe-285f-44c5-a183-24817640a820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:16.313530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:16.314634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:16.315745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:16.315745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:16.315745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:16.315745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:16.315745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 452/886] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:16.322681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:16.402557 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:16.427577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5013d0-4ef5-40a6-b219-901337bd5be9 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:16.462678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:16.463267 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:16.463547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:16.463815 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:16.464531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:16.464899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:16.466286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:16.478244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 435/887] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:16.484385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119abe-285f-44c5-a183-24817640a820 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:16.588441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119abe-285f-44c5-a183-24817640a820 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:16.608492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:16.623942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:16.624786 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:16.625073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:16.625352 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:16.633157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:16.634630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:52:16.649469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:16.650556 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:16.651668 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:16.652780 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 453/888] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:16.656866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:16.767778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff6602-0daf-45b7-8e6a-e4a8fc519349 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:16.803584 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:16.804253 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:16.804530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:16.804836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:16.805660 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:16.805960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:16.807395 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:16.810037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:16.824970 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 436/889] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jul 23 20:52:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:16.830935 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:16.937216 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a46b6-280d-4086-a673-2fa08790e7a9 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:16.973321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:16.974107 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:16.974384 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:16.974650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:16.988995 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:16.990451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:17.008142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:17.009122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:17.010027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:17.010027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:17.010027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:17.010027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:17.010027 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 454/890] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:17.015529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:17.123419 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4479ba-37b0-4c43-853a-8797670e7beb None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:17.158842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:17.159509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:17.159788 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:17.160029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:17.161174 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:17.161476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:17.162853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:17.174530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 437/891] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:17.180501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:17.213117 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:17.287264 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f551-9707-4bdb-9f50-0b3ee4edbea8 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:17.323768 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:17.324663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:17.324924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:17.325191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:17.332996 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:17.334480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:52:17.349396 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:17.350465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:17.351538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 455/892] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:17.356950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:17.422843 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:17.468765 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c9a2-b5f9-43da-a9d3-b07a97c3cbd8 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:17.502080 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:17.502745 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:17.503024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:17.503280 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:17.504058 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:17.504364 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:17.505825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2e5e-813b-43d5-99a5-ca2e978511a4 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:17.518140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 438/893] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:17.524388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:17.619937 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:17.630284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9b206-ac72-4a12-8ac7-de745fad2927 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:17.666296 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8680b-7146-4156-999c-e16da3ef2cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:17.667181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8680b-7146-4156-999c-e16da3ef2cb4 None admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:17.667464 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8680b-7146-4156-999c-e16da3ef2cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:17.667750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8680b-7146-4156-999c-e16da3ef2cb4 None admin] PATH_INFO: `/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/74b7c0b2078f4349bdf2fbb717fc7d93/roles/d384469b72f5485190c772f8974438e0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:17.669880 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8680b-7146-4156-999c-e16da3ef2cb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b8297aa7348728884cac62ab1232a, user_id=74b7c0b2078f4349bdf2fbb717fc7d93, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:17.671331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8680b-7146-4156-999c-e16da3ef2cb4 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:17.685426 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 456/894] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jul 23 20:52:17 2022] PUT /identity/v3/projects/0f1b8297aa7348728884cac62ab1232a/users/74b7c0b2078f4349bdf2fbb717fc7d93/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:52:19.912658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600c9f-30f2-458c-ba0c-668d458ec294 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:19.913240 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600c9f-30f2-458c-ba0c-668d458ec294 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:19.913240 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600c9f-30f2-458c-ba0c-668d458ec294 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:19.914628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 439/895] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:52:19.922300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:19.922940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:19.922940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:19.945221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:19.946962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:20.030294 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 457/896] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:19 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:20.058620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600c9f-30f2-458c-ba0c-668d458ec294 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:20.174344 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600c9f-30f2-458c-ba0c-668d458ec294 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:20.189195 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:20.211053 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:20.211853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:20.212118 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:20.212398 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:20.223214 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:52:20.230845 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:20.231925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:20.232989 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 440/897] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jul 23 20:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:20.238474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:20.332499 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:20.355411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b9fe-58f7-4dbc-9204-42c575401e56 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:20.397698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:20.398368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:20.398652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:20.398927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:20.399675 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:20.399977 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:20.401385 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:20.410140 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 458/898] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jul 23 20:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:20.416850 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:20.523370 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2867f5-ce49-4055-bf91-84e9fb22722b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:20.558067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:20.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:20.559295 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:20.559561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:20.570759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:20.572228 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:20.590483 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:20.591625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:20.592983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:20.592983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:20.592983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:20.592983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:20.592983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 441/899] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:20.597861 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:20.708131 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69e92-43d7-4f00-b8ea-3f90bbe7ed6d None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:20.748743 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:20.749421 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:20.749697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:20.749969 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:20.750706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:20.751010 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:20.752399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:20.765524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 459/900] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:20.773546 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:20.808482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:20.883798 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c66e2-4e51-46f5-a56b-6dd551d6b2f9 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:20.926526 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:20.927358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:20.927631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:20.927905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:20.937836 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:20.939298 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:52:20.954001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:20.955012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:20.956063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 442/901] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:20.961951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:20.966448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:21.075085 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b45ad-f4d9-431b-842c-58659fcabf8b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:21.112412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:21.113126 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:21.113408 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:21.113679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:21.114509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:21.114815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:21.116263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:21.134300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 460/902] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jul 23 20:52:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:21.140401 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:21.235303 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:21.251823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173e8a7-8ab2-4281-b8aa-682fd52d257b None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:21.288449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:21.289137 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:21.289431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:21.289690 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:21.363236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:21.364652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:21.452544 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:21.469647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 443/903] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jul 23 20:52:21 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:52:21.475779 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:21.545048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:21.588661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190a8cf-c727-4894-8f47-48d1172f261f None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:21.628824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:21.629532 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:21.629812 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:21.630086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:21.640574 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:21.642100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:52:21.660146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:21.662272 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:21.663535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:52:21.663535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:52:21.663535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:52:21.663535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:21.663535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 461/904] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:21.670631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:21.771128 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d623-826c-4bf0-89d0-a158602ef29d None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:21.807156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:21.807822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:21.808100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:21.808433 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:21.809194 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:21.809494 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:21.810881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:21.824103 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 444/905] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jul 23 20:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:21.830830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:21.949333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeafb0e-a7e4-4479-8e35-4ccfcaba8c5b None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:21.965582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:21.988561 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:21.989391 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:21.989669 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:21.989958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:21.997094 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:21.998541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:52:22.012704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:22.013785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: ERROR keystone.server.flask.application Jul 23 20:52:22.015138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 462/906] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jul 23 20:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:22.020182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:22.069722 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:22.135083 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a4067-ec63-4871-93c9-748aa33e1c96 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:22.179423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:22.180442 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:22.180909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:22.181342 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:22.182656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:22.183164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:22.185408 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076a9d1-baee-4152-a733-e87726f26fc0 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:22.202126 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 445/907] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jul 23 20:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:22.208563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:22.316482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ae35-29ea-4ff0-b51a-85c573afd8d5 None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:22.351631 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:22.352284 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:22.352563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:22.352872 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:22.353690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] RBAC: Adding query filter params (role.id=d384469b72f5485190c772f8974438e0, scope.project.id=0f1b8297aa7348728884cac62ab1232a, user.id=74b7c0b2078f4349bdf2fbb717fc7d93) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:22.354001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:22.355474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf114b3-dd63-4d71-99c1-9f5838578f52 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:22.361669 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 463/908] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jul 23 20:52:22 2022] GET /identity/v3/role_assignments?user.id=74b7c0b2078f4349bdf2fbb717fc7d93&scope.project.id=0f1b8297aa7348728884cac62ab1232a&role.id=d384469b72f5485190c772f8974438e0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:24.591166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d28b-301c-4c41-b2b2-67e2f609cf47 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:24.591765 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d28b-301c-4c41-b2b2-67e2f609cf47 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:24.591765 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d28b-301c-4c41-b2b2-67e2f609cf47 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:24.593144 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 446/909] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:24.598506 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:24.598934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:24.599023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:24.617013 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:24.618235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:24.648273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:24.689493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 464/910] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:24 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:24.713340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d28b-301c-4c41-b2b2-67e2f609cf47 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:24.823831 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d28b-301c-4c41-b2b2-67e2f609cf47 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:24.832076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:24.862350 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:24.863064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:24.863325 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:24.863600 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:24.864256 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:24.865681 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:24.877746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:24.878908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:24.879899 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 447/911] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jul 23 20:52:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:24.885307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:24.999641 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30292-bd24-420f-9782-bb064864b3eb None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:25.033662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:25.034341 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:25.034622 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:25.034899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:25.035968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:25.036275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:25.037697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de04d04-45a8-490a-b5b8-e17d2f609be8 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:25.042824 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 465/912] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jul 23 20:52:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:25.048959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:25.165692 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ae6bb-3ef0-4ceb-a887-55aa4ce1e9fd None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:25.200050 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:25.201029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:25.201301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:25.201556 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] PATH_INFO: `/v3/services` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:25.202248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:25.202550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:25.203923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e1dc1-6dc0-4304-98c4-9685498f2cd2 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:25.208352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 448/913] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jul 23 20:52:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:27.431759 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7644-fdce-45f5-afdb-73eb0735d824 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:27.432339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7644-fdce-45f5-afdb-73eb0735d824 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:27.432339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7644-fdce-45f5-afdb-73eb0735d824 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:27.433819 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 466/914] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:27.439153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701d785-28d4-4059-8b6a-30ff412cf134 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:27.439608 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701d785-28d4-4059-8b6a-30ff412cf134 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:27.439719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701d785-28d4-4059-8b6a-30ff412cf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:27.458438 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-6701d785-28d4-4059-8b6a-30ff412cf134 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:27.459699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-6701d785-28d4-4059-8b6a-30ff412cf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:27.490179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:27.533082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 449/915] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:27.557636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7644-fdce-45f5-afdb-73eb0735d824 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:27.591804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:27.667188 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7644-fdce-45f5-afdb-73eb0735d824 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:27.703480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b284-9f73-4b2f-abeb-05e266d9feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:27.704138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b284-9f73-4b2f-abeb-05e266d9feb0 None admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:27.704418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b284-9f73-4b2f-abeb-05e266d9feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:27.704702 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b284-9f73-4b2f-abeb-05e266d9feb0 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:27.705451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b284-9f73-4b2f-abeb-05e266d9feb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:27.706832 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b284-9f73-4b2f-abeb-05e266d9feb0 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:27.725057 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 467/916] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jul 23 20:52:27 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:52:29.959860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c785-1a48-4c6f-9262-d1346c5c7ceb None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:29.960422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c785-1a48-4c6f-9262-d1346c5c7ceb None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:29.960422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c785-1a48-4c6f-9262-d1346c5c7ceb None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:29.961834 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 450/917] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:29.967192 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:29.967623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:29.967713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:29.985017 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:29.986204 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:30.061861 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 468/918] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:29 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:30.085924 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45c785-1a48-4c6f-9262-d1346c5c7ceb None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:30.190844 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45c785-1a48-4c6f-9262-d1346c5c7ceb None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:30.232593 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:30.233342 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:30.233620 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:30.233888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:30.234540 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:30.235907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:30.248301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:30.249459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:30.250296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 451/919] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jul 23 20:52:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:30.255715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:30.274463 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:30.355584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591af438-f673-43a5-91d4-ef4afeffc8f1 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:30.391899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:30.392576 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:30.392893 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:30.393171 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:30.393879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:30.394186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:30.395588 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:30.401016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 469/920] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jul 23 20:52:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:30.407450 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:30.437425 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:30.510829 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba5795-deba-44fb-935c-8a62aa1ed7a5 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:30.545652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:30.546301 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:30.546580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:30.546853 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:30.547648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] RBAC: Adding query filter params (interface=public, service_id=1ec4e957394c44228b48bd3a65ab6592, region_id=RegionOne) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:30.547954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:30.549366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bbb65-9c2a-45fb-93fd-04980808d0ce None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:30.554547 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 452/921] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jul 23 20:52:30 2022] GET /identity/v3/endpoints?service_id=1ec4e957394c44228b48bd3a65ab6592&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:30.560482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:30.650510 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:30.670468 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3858-5284-43f4-8b34-9053f46c40ba None admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:30.705501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857a94-6a15-4351-bb06-410d726a34bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:30.706159 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857a94-6a15-4351-bb06-410d726a34bb None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:30.706441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857a94-6a15-4351-bb06-410d726a34bb None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:30.706715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857a94-6a15-4351-bb06-410d726a34bb None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:30.707398 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857a94-6a15-4351-bb06-410d726a34bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:30.708813 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857a94-6a15-4351-bb06-410d726a34bb None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:30.715489 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 470/922] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jul 23 20:52:30 2022] GET /identity/v3/services => generated 1962 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:52:32.937305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0997-2e8a-4cf8-b557-d057ccebdd5c None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:32.937872 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0997-2e8a-4cf8-b557-d057ccebdd5c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:32.937872 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0997-2e8a-4cf8-b557-d057ccebdd5c None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:32.939262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 453/923] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:52:32.945037 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:32.945490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:32.945580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:32.970112 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:52:32.971666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:52:33.047486 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 471/924] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:52:32 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:52:33.072309 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0997-2e8a-4cf8-b557-d057ccebdd5c None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:33.171443 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:33.183361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0997-2e8a-4cf8-b557-d057ccebdd5c None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:33.218633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:33.219358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:33.219635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:33.219904 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:33.220561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:33.221985 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:52:33.234274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:52:33.235348 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application with Lock( Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: ERROR keystone.server.flask.application Jul 23 20:52:33.241294 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 454/925] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jul 23 20:52:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:52:33.242277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:33.325629 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:33.354203 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f7a01-8015-4dae-b7a7-5ea707f6d507 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:33.388990 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:33.389652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:33.389927 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:33.390196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] PATH_INFO: `/v3/services` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:33.390924 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:52:33.391223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:33.392621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2b19-af68-45c3-8d2e-2d2fafabfb75 None admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:33.397739 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 472/926] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jul 23 20:52:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:52:33.403927 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:52:33.505165 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7e9dd-769c-43c3-a2f1-794b65f98078 None admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:52:33.539949 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2b89-7ada-4c58-bef8-6a69e329618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:52:33.540645 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2b89-7ada-4c58-bef8-6a69e329618b None admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:52:33.540923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2b89-7ada-4c58-bef8-6a69e329618b None admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:52:33.541196 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2b89-7ada-4c58-bef8-6a69e329618b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:52:33.541947 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2b89-7ada-4c58-bef8-6a69e329618b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:52:33.543443 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2b89-7ada-4c58-bef8-6a69e329618b None admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:52:33.564511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 455/927] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jul 23 20:52:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:52:43.394793 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=30 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:52:43.560120 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:53:32.635156 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237563a3-beb0-4202-ab29-09586c67be4a None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:32.635738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237563a3-beb0-4202-ab29-09586c67be4a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:32.635738 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237563a3-beb0-4202-ab29-09586c67be4a None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:32.637163 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 473/928] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:32.642574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96392c-e000-48b6-8d03-e20a03b6d1e0 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:32.643043 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96392c-e000-48b6-8d03-e20a03b6d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:32.643131 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96392c-e000-48b6-8d03-e20a03b6d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:32.676013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-0a96392c-e000-48b6-8d03-e20a03b6d1e0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:32.676013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0a96392c-e000-48b6-8d03-e20a03b6d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:32.775723 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 456/929] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:32.826775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a901-687c-4738-9328-3761759a6853 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:32.827091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a901-687c-4738-9328-3761759a6853 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:32.827474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a901-687c-4738-9328-3761759a6853 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:32.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 474/930] 10.222.0.18 () {54 vars in 965 bytes} [Sat Jul 23 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:32.835517 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1864d8-1852-4a47-b025-40b81ceb3cd2 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:32.835813 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1864d8-1852-4a47-b025-40b81ceb3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:32.836085 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1864d8-1852-4a47-b025-40b81ceb3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:32.923459 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-bc1864d8-1852-4a47-b025-40b81ceb3cd2 None None] MFA Rules not processed for user `e27cdef8bd764dbf8243a4e0f4d8102a`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:32.924716 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-bc1864d8-1852-4a47-b025-40b81ceb3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:33.017106 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 457/931] 10.222.0.18 () {58 vars in 1062 bytes} [Sat Jul 23 20:53:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:33.025210 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a901-687c-4738-9328-3761759a6853 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:33.040559 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a901-687c-4738-9328-3761759a6853 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:33.044963 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e529-948a-4a32-98a3-473222904f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:33.045795 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e529-948a-4a32-98a3-473222904f4f service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:33.046303 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e529-948a-4a32-98a3-473222904f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:33.046666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e529-948a-4a32-98a3-473222904f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:33.058240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e529-948a-4a32-98a3-473222904f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:33.059697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e529-948a-4a32-98a3-473222904f4f service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:33.072737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 475/932] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:35.603777 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77b66-8bd0-4ba7-8113-49a900d8944e None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:35.604375 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77b66-8bd0-4ba7-8113-49a900d8944e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:35.604375 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77b66-8bd0-4ba7-8113-49a900d8944e None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:35.605874 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 458/933] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:35.611394 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286278e2-6bf4-4ad4-a691-a2f5894ba6dd None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:35.611860 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286278e2-6bf4-4ad4-a691-a2f5894ba6dd None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:35.612084 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286278e2-6bf4-4ad4-a691-a2f5894ba6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:35.632663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-286278e2-6bf4-4ad4-a691-a2f5894ba6dd None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:35.634035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-286278e2-6bf4-4ad4-a691-a2f5894ba6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:35.642716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 476/934] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:53:35.682652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77b66-8bd0-4ba7-8113-49a900d8944e None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:35.694816 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77b66-8bd0-4ba7-8113-49a900d8944e None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:35.699440 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9c1c-590c-4f46-98bb-fcccf7a1aa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:35.700181 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9c1c-590c-4f46-98bb-fcccf7a1aa60 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:35.700529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9c1c-590c-4f46-98bb-fcccf7a1aa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:35.700837 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9c1c-590c-4f46-98bb-fcccf7a1aa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:35.710672 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f9c1c-590c-4f46-98bb-fcccf7a1aa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:35.712124 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f9c1c-590c-4f46-98bb-fcccf7a1aa60 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:35.721728 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 459/935] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:38.340713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a107-e68a-4fc3-8826-5b29557cab90 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:38.341285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a107-e68a-4fc3-8826-5b29557cab90 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:38.341285 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a107-e68a-4fc3-8826-5b29557cab90 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:38.342678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 477/936] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:38.348129 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a44c-fd3a-42f1-9112-8ecab5331386 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:38.348568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a44c-fd3a-42f1-9112-8ecab5331386 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:38.348819 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a44c-fd3a-42f1-9112-8ecab5331386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:38.388299 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-6658a44c-fd3a-42f1-9112-8ecab5331386 None None] MFA Rules not processed for user `08fb641a93854b1bbaaade59a09529f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:38.389552 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-6658a44c-fd3a-42f1-9112-8ecab5331386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:38.431613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:53:38.460451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 460/937] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:38 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:38.501276 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196a107-e68a-4fc3-8826-5b29557cab90 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:38.513063 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196a107-e68a-4fc3-8826-5b29557cab90 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:38.517151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af6840-b489-435c-8bdd-406f8e17a35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:38.517913 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6840-b489-435c-8bdd-406f8e17a35b service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:38.518299 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6840-b489-435c-8bdd-406f8e17a35b service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:38.518725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af6840-b489-435c-8bdd-406f8e17a35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:38.528473 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6840-b489-435c-8bdd-406f8e17a35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:38.530052 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af6840-b489-435c-8bdd-406f8e17a35b service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:38.540665 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 478/938] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:38 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:41.431359 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbe39b-d0ee-47b0-86fa-cedda5e5095a None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:41.431912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbe39b-d0ee-47b0-86fa-cedda5e5095a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:41.431912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbe39b-d0ee-47b0-86fa-cedda5e5095a None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:41.433379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 461/939] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:41.439862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bcc13-9780-47c2-86e1-556743cd584d None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:41.440339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bcc13-9780-47c2-86e1-556743cd584d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:41.440449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bcc13-9780-47c2-86e1-556743cd584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:41.459270 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-640bcc13-9780-47c2-86e1-556743cd584d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:41.460915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-640bcc13-9780-47c2-86e1-556743cd584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:41.533876 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 479/940] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:41 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:41.575730 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbe39b-d0ee-47b0-86fa-cedda5e5095a None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:41.587959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbe39b-d0ee-47b0-86fa-cedda5e5095a None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:41.591693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b35f-f0da-4fbc-8181-492203b9c74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:41.592335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b35f-f0da-4fbc-8181-492203b9c74b service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:41.592628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b35f-f0da-4fbc-8181-492203b9c74b service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:41.592917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b35f-f0da-4fbc-8181-492203b9c74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:41.606022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b35f-f0da-4fbc-8181-492203b9c74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:41.607467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b35f-f0da-4fbc-8181-492203b9c74b service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:41.619420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 462/941] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:41 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:44.564840 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f8380-5a17-4a9e-99ed-59906928da11 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:44.565474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f8380-5a17-4a9e-99ed-59906928da11 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:44.565474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f8380-5a17-4a9e-99ed-59906928da11 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:44.566751 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 480/942] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:44.572368 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058c5fb-ea08-47d4-ba0a-87c100efe664 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:44.572840 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058c5fb-ea08-47d4-ba0a-87c100efe664 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:44.572986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058c5fb-ea08-47d4-ba0a-87c100efe664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:44.594160 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-5058c5fb-ea08-47d4-ba0a-87c100efe664 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:44.595372 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-5058c5fb-ea08-47d4-ba0a-87c100efe664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:44.604711 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 463/943] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:44.656471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71875f8-9fd1-42dc-88d8-7157924c06ac None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:44.656746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71875f8-9fd1-42dc-88d8-7157924c06ac None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:44.657055 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71875f8-9fd1-42dc-88d8-7157924c06ac None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:44.658801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 481/944] 10.222.0.18 () {54 vars in 965 bytes} [Sat Jul 23 20:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:44.665094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459a11-bb58-4bdf-9b6b-671654f1aae7 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:44.665454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459a11-bb58-4bdf-9b6b-671654f1aae7 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:44.665870 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459a11-bb58-4bdf-9b6b-671654f1aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:44.684463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f5459a11-bb58-4bdf-9b6b-671654f1aae7 None None] MFA Rules not processed for user `e27cdef8bd764dbf8243a4e0f4d8102a`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:44.685763 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f5459a11-bb58-4bdf-9b6b-671654f1aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:44.692782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 464/945] 10.222.0.18 () {58 vars in 1062 bytes} [Sat Jul 23 20:53:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:44.701611 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71875f8-9fd1-42dc-88d8-7157924c06ac None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:44.712825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71875f8-9fd1-42dc-88d8-7157924c06ac None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:44.716994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56191b-fb3b-4765-a7f4-dd54444159b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:44.717635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56191b-fb3b-4765-a7f4-dd54444159b7 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:44.717921 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56191b-fb3b-4765-a7f4-dd54444159b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:44.718180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56191b-fb3b-4765-a7f4-dd54444159b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:44.728443 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56191b-fb3b-4765-a7f4-dd54444159b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:44.729994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56191b-fb3b-4765-a7f4-dd54444159b7 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:44.739775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 482/946] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 20:53:47.240217 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27a36e-0541-4b62-a15d-678ea63b32c1 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:47.240822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27a36e-0541-4b62-a15d-678ea63b32c1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:47.240822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27a36e-0541-4b62-a15d-678ea63b32c1 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:47.242201 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 465/947] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:47.248044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0ded-284d-4e61-943f-82931eacfed5 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:47.248539 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0ded-284d-4e61-943f-82931eacfed5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:47.248761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0ded-284d-4e61-943f-82931eacfed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:47.268053 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b3dd0ded-284d-4e61-943f-82931eacfed5 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:47.269327 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b3dd0ded-284d-4e61-943f-82931eacfed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:47.278997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 483/948] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:47.316649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27a36e-0541-4b62-a15d-678ea63b32c1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:47.329111 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27a36e-0541-4b62-a15d-678ea63b32c1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:47.333505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881423b-8d08-4cb0-b259-9d4ad479c48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:47.334154 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881423b-8d08-4cb0-b259-9d4ad479c48a service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:47.334440 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881423b-8d08-4cb0-b259-9d4ad479c48a service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:47.334713 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881423b-8d08-4cb0-b259-9d4ad479c48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:47.344506 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881423b-8d08-4cb0-b259-9d4ad479c48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:47.345995 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881423b-8d08-4cb0-b259-9d4ad479c48a service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:47.356026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 466/949] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:49.658934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6543ec-00e0-4464-a875-ea0e77b55454 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:49.659543 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6543ec-00e0-4464-a875-ea0e77b55454 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:49.659543 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6543ec-00e0-4464-a875-ea0e77b55454 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:49.661358 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 484/950] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:49.669316 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6f43-782f-40da-bc52-ff772402ea31 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:49.669848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6f43-782f-40da-bc52-ff772402ea31 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:49.669848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6f43-782f-40da-bc52-ff772402ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:49.690516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-6d4d6f43-782f-40da-bc52-ff772402ea31 None None] MFA Rules not processed for user `08fb641a93854b1bbaaade59a09529f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:49.691736 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-6d4d6f43-782f-40da-bc52-ff772402ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:49.704569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 467/951] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:49 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:49.745522 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6543ec-00e0-4464-a875-ea0e77b55454 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:49.756448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6543ec-00e0-4464-a875-ea0e77b55454 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:49.760291 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15297d-38f3-4550-9729-b43c6b8f4207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:49.760982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15297d-38f3-4550-9729-b43c6b8f4207 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:49.761266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15297d-38f3-4550-9729-b43c6b8f4207 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:49.761542 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15297d-38f3-4550-9729-b43c6b8f4207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:49.771394 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15297d-38f3-4550-9729-b43c6b8f4207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:49.772887 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15297d-38f3-4550-9729-b43c6b8f4207 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:49.783877 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 485/952] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:49 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:52.493498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d9b0-dccb-4a72-a5bf-8f39f65dc852 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:52.494072 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d9b0-dccb-4a72-a5bf-8f39f65dc852 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:52.494072 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d9b0-dccb-4a72-a5bf-8f39f65dc852 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:52.495313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 468/953] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:52.501490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20644b-e46e-4413-9ad3-929c55a82685 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:52.502033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20644b-e46e-4413-9ad3-929c55a82685 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:52.502033 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20644b-e46e-4413-9ad3-929c55a82685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:52.521634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-2f20644b-e46e-4413-9ad3-929c55a82685 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:52.522862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-2f20644b-e46e-4413-9ad3-929c55a82685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:52.531928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 486/954] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:52.569889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d9b0-dccb-4a72-a5bf-8f39f65dc852 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:52.582393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d9b0-dccb-4a72-a5bf-8f39f65dc852 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:52.586528 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074a913-6cdb-40ba-bfbf-9fd0367fc968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:52.587179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a913-6cdb-40ba-bfbf-9fd0367fc968 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:52.587462 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a913-6cdb-40ba-bfbf-9fd0367fc968 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:52.587741 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a913-6cdb-40ba-bfbf-9fd0367fc968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:52.597343 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074a913-6cdb-40ba-bfbf-9fd0367fc968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:52.598828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074a913-6cdb-40ba-bfbf-9fd0367fc968 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:52.609261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 469/955] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:54.914783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97132723-79c2-4c17-849b-d8004ea97022 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:54.915382 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97132723-79c2-4c17-849b-d8004ea97022 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:54.915382 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97132723-79c2-4c17-849b-d8004ea97022 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:54.916757 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 487/956] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:54.922128 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50c698-2cc4-4e06-8de5-8bb7ab65f4c4 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:54.922580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50c698-2cc4-4e06-8de5-8bb7ab65f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:54.922676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50c698-2cc4-4e06-8de5-8bb7ab65f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:54.941671 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-dd50c698-2cc4-4e06-8de5-8bb7ab65f4c4 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:54.942919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-dd50c698-2cc4-4e06-8de5-8bb7ab65f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:54.952018 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 470/957] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:54.993628 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97132723-79c2-4c17-849b-d8004ea97022 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:54.999377 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=65 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:53:55.005783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97132723-79c2-4c17-849b-d8004ea97022 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:55.009573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41385ba6-e77e-4d98-a92f-0b30d4f98afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:55.010209 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385ba6-e77e-4d98-a92f-0b30d4f98afb service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:55.010450 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385ba6-e77e-4d98-a92f-0b30d4f98afb service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:55.010752 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385ba6-e77e-4d98-a92f-0b30d4f98afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:55.020267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385ba6-e77e-4d98-a92f-0b30d4f98afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:55.021749 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385ba6-e77e-4d98-a92f-0b30d4f98afb service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:55.031462 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 488/958] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:53:57.791001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6961fa-a8dd-4d7f-9c2c-8b9e126a0410 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:57.791580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6961fa-a8dd-4d7f-9c2c-8b9e126a0410 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:57.791580 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6961fa-a8dd-4d7f-9c2c-8b9e126a0410 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:57.792957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 471/959] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:53:57.798598 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e35668-f01f-4ec3-a528-b53826cdb799 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:57.799251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e35668-f01f-4ec3-a528-b53826cdb799 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:57.799251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e35668-f01f-4ec3-a528-b53826cdb799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:57.822181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-89e35668-f01f-4ec3-a528-b53826cdb799 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:53:57.823395 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-89e35668-f01f-4ec3-a528-b53826cdb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:53:57.832820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 489/960] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:53:57 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:53:57.871471 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6961fa-a8dd-4d7f-9c2c-8b9e126a0410 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:53:57.887108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6961fa-a8dd-4d7f-9c2c-8b9e126a0410 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:53:57.891358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a146f-3b16-4da0-9538-756522ebb672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:53:57.892015 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a146f-3b16-4da0-9538-756522ebb672 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:53:57.892310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a146f-3b16-4da0-9538-756522ebb672 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:53:57.892578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a146f-3b16-4da0-9538-756522ebb672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:53:57.903082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a146f-3b16-4da0-9538-756522ebb672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:53:57.904630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a146f-3b16-4da0-9538-756522ebb672 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:53:57.915179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 472/961] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:53:57 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:02.272535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b34e-5044-4163-b5f2-6ecbda51185e None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:02.273090 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b34e-5044-4163-b5f2-6ecbda51185e None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:02.273090 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b34e-5044-4163-b5f2-6ecbda51185e None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:02.274623 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 490/962] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:02.280493 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89054af-74fd-4571-b640-50a4a0e31b95 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:02.280994 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89054af-74fd-4571-b640-50a4a0e31b95 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:02.281109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89054af-74fd-4571-b640-50a4a0e31b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:02.301024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-b89054af-74fd-4571-b640-50a4a0e31b95 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:02.302357 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-b89054af-74fd-4571-b640-50a4a0e31b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:02.310937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 473/963] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:02.351268 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b34e-5044-4163-b5f2-6ecbda51185e None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:02.363277 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b34e-5044-4163-b5f2-6ecbda51185e None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:02.367103 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9f8d-abc9-4ebd-9c43-31a9fdaf967e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:02.367820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9f8d-abc9-4ebd-9c43-31a9fdaf967e service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:02.368092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9f8d-abc9-4ebd-9c43-31a9fdaf967e service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:02.368358 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9f8d-abc9-4ebd-9c43-31a9fdaf967e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:02.381269 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf9f8d-abc9-4ebd-9c43-31a9fdaf967e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:02.382851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf9f8d-abc9-4ebd-9c43-31a9fdaf967e service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:02.392897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 491/964] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:05.465172 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d36eee-8522-4e15-914e-4802dbaa5ad1 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:05.465776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d36eee-8522-4e15-914e-4802dbaa5ad1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:05.465776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d36eee-8522-4e15-914e-4802dbaa5ad1 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:05.467148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 474/965] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:05.473359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2492b3-e1e5-495d-8b8d-bc3605ba24a2 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:05.473923 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2492b3-e1e5-495d-8b8d-bc3605ba24a2 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:05.473923 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2492b3-e1e5-495d-8b8d-bc3605ba24a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:05.494050 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-7f2492b3-e1e5-495d-8b8d-bc3605ba24a2 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:05.495334 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-7f2492b3-e1e5-495d-8b8d-bc3605ba24a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:05.505018 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 492/966] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:05 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:05.544585 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d36eee-8522-4e15-914e-4802dbaa5ad1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:05.556727 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d36eee-8522-4e15-914e-4802dbaa5ad1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:05.560815 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f51c0-e0a0-46e7-9cc7-abe094dafe4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:05.561474 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f51c0-e0a0-46e7-9cc7-abe094dafe4f service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:05.561753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f51c0-e0a0-46e7-9cc7-abe094dafe4f service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:05.562029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f51c0-e0a0-46e7-9cc7-abe094dafe4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:05.572663 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f51c0-e0a0-46e7-9cc7-abe094dafe4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:05.574118 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f51c0-e0a0-46e7-9cc7-abe094dafe4f service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:05.585056 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 475/967] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:05 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:10.111306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d697e8-6ac6-4a8e-8f96-8e302c3e8863 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:10.112241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d697e8-6ac6-4a8e-8f96-8e302c3e8863 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:10.112492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d697e8-6ac6-4a8e-8f96-8e302c3e8863 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:10.113949 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 493/968] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:10.119848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c51841-a482-4911-91c6-37f85ec30819 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:10.120324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c51841-a482-4911-91c6-37f85ec30819 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:10.120499 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c51841-a482-4911-91c6-37f85ec30819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:10.127056 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=57 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:54:10.139761 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-86c51841-a482-4911-91c6-37f85ec30819 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:10.141102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-86c51841-a482-4911-91c6-37f85ec30819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:10.149320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 476/969] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:10.192243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d697e8-6ac6-4a8e-8f96-8e302c3e8863 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:10.204433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d697e8-6ac6-4a8e-8f96-8e302c3e8863 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:10.210273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66695b-fc47-42af-98e2-9f67babc2418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:10.211026 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66695b-fc47-42af-98e2-9f67babc2418 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:10.211366 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66695b-fc47-42af-98e2-9f67babc2418 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:10.211632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66695b-fc47-42af-98e2-9f67babc2418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:10.221949 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66695b-fc47-42af-98e2-9f67babc2418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:10.223412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66695b-fc47-42af-98e2-9f67babc2418 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:10.233430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 494/970] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:15.655581 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf829-48e1-46f6-85f4-e3c28a26047c None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:15.657967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf829-48e1-46f6-85f4-e3c28a26047c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:15.667082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf829-48e1-46f6-85f4-e3c28a26047c None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:15.667082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 477/971] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 20:54:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:15.670847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d75c7-c4f4-4f01-90ae-babc64ecd8b4 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:15.671777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d75c7-c4f4-4f01-90ae-babc64ecd8b4 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:15.672239 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d75c7-c4f4-4f01-90ae-babc64ecd8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:15.726458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-bf0d75c7-c4f4-4f01-90ae-babc64ecd8b4 None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:15.728010 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-bf0d75c7-c4f4-4f01-90ae-babc64ecd8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:15.804518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 495/972] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 20:54:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:20.136235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=2 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:54:20.163391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e667ac-bcdc-40a4-9f32-998370c084ab None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:20.163774 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e667ac-bcdc-40a4-9f32-998370c084ab None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:20.164026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e667ac-bcdc-40a4-9f32-998370c084ab None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:20.165680 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 478/973] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 20:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:20.171097 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4da6-caf1-4b89-844d-77f3bb12bb6a None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:20.171933 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4da6-caf1-4b89-844d-77f3bb12bb6a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:20.172390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4da6-caf1-4b89-844d-77f3bb12bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:20.191954 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-2e0a4da6-caf1-4b89-844d-77f3bb12bb6a None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:20.193196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-2e0a4da6-caf1-4b89-844d-77f3bb12bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:20.201906 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 496/974] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 20:54:20 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:21.817149 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790562d9-8f73-4a66-bd27-6dbb1d7c4123 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:21.817704 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790562d9-8f73-4a66-bd27-6dbb1d7c4123 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:21.817963 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790562d9-8f73-4a66-bd27-6dbb1d7c4123 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:21.819972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 479/975] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 20:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:21.825983 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77fc7-9e5e-44e2-bfd4-9d5a4b0c4bb7 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:21.826530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77fc7-9e5e-44e2-bfd4-9d5a4b0c4bb7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:21.826783 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77fc7-9e5e-44e2-bfd4-9d5a4b0c4bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:21.846488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-77b77fc7-9e5e-44e2-bfd4-9d5a4b0c4bb7 None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:21.847717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-77b77fc7-9e5e-44e2-bfd4-9d5a4b0c4bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:21.857805 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 497/976] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 20:54:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:25.872451 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcc083-f54e-4623-a907-00284adc01df None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:25.873073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcc083-f54e-4623-a907-00284adc01df None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:25.873073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcc083-f54e-4623-a907-00284adc01df None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:25.874413 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 480/977] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:25.879629 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502981d-1dea-4440-bb5e-e1b594e25050 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:25.880036 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502981d-1dea-4440-bb5e-e1b594e25050 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:25.880173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502981d-1dea-4440-bb5e-e1b594e25050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:25.886762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=69 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:54:25.900503 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-4502981d-1dea-4440-bb5e-e1b594e25050 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:25.901884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4502981d-1dea-4440-bb5e-e1b594e25050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:25.912437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 498/978] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:25.973018 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8fe76-4583-4bd6-ba9c-748ffebd0e93 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:25.973504 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8fe76-4583-4bd6-ba9c-748ffebd0e93 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:25.973929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8fe76-4583-4bd6-ba9c-748ffebd0e93 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:25.975531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 481/979] 10.222.0.18 () {54 vars in 962 bytes} [Sat Jul 23 20:54:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:25.985689 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f383-abaa-4cb4-a453-bb5ff9cad65b None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:25.986455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f383-abaa-4cb4-a453-bb5ff9cad65b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:25.986905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f383-abaa-4cb4-a453-bb5ff9cad65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:26.027510 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-f9d4f383-abaa-4cb4-a453-bb5ff9cad65b None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:26.028750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-f9d4f383-abaa-4cb4-a453-bb5ff9cad65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:26.101985 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 499/980] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jul 23 20:54:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:26.110250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8fe76-4583-4bd6-ba9c-748ffebd0e93 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:26.124410 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8fe76-4583-4bd6-ba9c-748ffebd0e93 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:26.129721 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064cae-4d16-4d48-aa44-b9743e38f5aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:26.130361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064cae-4d16-4d48-aa44-b9743e38f5aa service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:26.130643 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064cae-4d16-4d48-aa44-b9743e38f5aa service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:26.130918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064cae-4d16-4d48-aa44-b9743e38f5aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:26.139361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac064cae-4d16-4d48-aa44-b9743e38f5aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:26.141185 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac064cae-4d16-4d48-aa44-b9743e38f5aa service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:26.150699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 482/981] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 20:54:28.636124 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d463d5-5265-47fd-b91b-f90d4c448e09 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:28.636915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d463d5-5265-47fd-b91b-f90d4c448e09 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:28.636915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d463d5-5265-47fd-b91b-f90d4c448e09 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:28.638048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 500/982] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:28.643652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbd1d-019c-4a67-adee-c24fdec399de None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:28.644092 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbd1d-019c-4a67-adee-c24fdec399de None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:28.644180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbd1d-019c-4a67-adee-c24fdec399de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:28.663058 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-57fcbd1d-019c-4a67-adee-c24fdec399de None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:28.664263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-57fcbd1d-019c-4a67-adee-c24fdec399de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:28.673013 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 483/983] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:28.719159 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d463d5-5265-47fd-b91b-f90d4c448e09 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:28.733582 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d463d5-5265-47fd-b91b-f90d4c448e09 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:28.738554 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a2fa-8294-416a-9dab-ef2e8b767e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:28.739201 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a2fa-8294-416a-9dab-ef2e8b767e9d service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:28.739485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a2fa-8294-416a-9dab-ef2e8b767e9d service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:28.739762 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a2fa-8294-416a-9dab-ef2e8b767e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:28.748101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a2fa-8294-416a-9dab-ef2e8b767e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:28.749736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a2fa-8294-416a-9dab-ef2e8b767e9d service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:28.761160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 501/984] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:31.349524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff02e-1825-475b-8b03-876fc1617680 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:31.350060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff02e-1825-475b-8b03-876fc1617680 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:31.350060 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff02e-1825-475b-8b03-876fc1617680 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:31.351466 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 484/985] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:31.356828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde1f5-149b-432e-ae6a-318434151780 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:31.357261 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde1f5-149b-432e-ae6a-318434151780 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:31.357359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde1f5-149b-432e-ae6a-318434151780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:31.376526 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-d0bde1f5-149b-432e-ae6a-318434151780 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:31.378123 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-d0bde1f5-149b-432e-ae6a-318434151780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:31.400312 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 502/986] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:31.450590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cff311-06d9-4aec-978a-723370556173 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:31.450812 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cff311-06d9-4aec-978a-723370556173 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:31.451091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cff311-06d9-4aec-978a-723370556173 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:31.452472 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 485/987] 10.222.0.18 () {54 vars in 962 bytes} [Sat Jul 23 20:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:31.458058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0957093-3746-4842-9d09-fc7dcc5ecf82 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:31.458388 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0957093-3746-4842-9d09-fc7dcc5ecf82 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:31.458691 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0957093-3746-4842-9d09-fc7dcc5ecf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:31.476923 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b0957093-3746-4842-9d09-fc7dcc5ecf82 None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:31.478101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b0957093-3746-4842-9d09-fc7dcc5ecf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:31.487345 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 503/988] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jul 23 20:54:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:31.495358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cff311-06d9-4aec-978a-723370556173 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:31.509571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cff311-06d9-4aec-978a-723370556173 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:31.515605 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca974-70db-4a91-9a08-a73bd1470114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:31.516261 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca974-70db-4a91-9a08-a73bd1470114 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:31.516545 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca974-70db-4a91-9a08-a73bd1470114 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:31.516871 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca974-70db-4a91-9a08-a73bd1470114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:31.525929 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ca974-70db-4a91-9a08-a73bd1470114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:31.527535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ca974-70db-4a91-9a08-a73bd1470114 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:31.537283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 486/989] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:33.930602 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151347d3-2b4b-4eeb-98bb-82774fc328a1 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:33.931474 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151347d3-2b4b-4eeb-98bb-82774fc328a1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:33.931904 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151347d3-2b4b-4eeb-98bb-82774fc328a1 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:33.933504 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 504/990] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:54:33.938922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b076-cc8c-4d31-9a79-f830b43c12d9 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:33.939287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b076-cc8c-4d31-9a79-f830b43c12d9 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:33.939481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2b076-cc8c-4d31-9a79-f830b43c12d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:33.958588 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-35e2b076-cc8c-4d31-9a79-f830b43c12d9 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:33.960274 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-35e2b076-cc8c-4d31-9a79-f830b43c12d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:33.977161 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 487/991] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:54:34.017047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151347d3-2b4b-4eeb-98bb-82774fc328a1 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:34.032025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151347d3-2b4b-4eeb-98bb-82774fc328a1 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:34.037309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f060d-7e6e-4eca-accf-cde9648f3403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:34.038211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f060d-7e6e-4eca-accf-cde9648f3403 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:34.038643 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f060d-7e6e-4eca-accf-cde9648f3403 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:34.039087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f060d-7e6e-4eca-accf-cde9648f3403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:34.048809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f060d-7e6e-4eca-accf-cde9648f3403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:34.050888 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f060d-7e6e-4eca-accf-cde9648f3403 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:34.061771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 505/992] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:36.011740 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cdc9-848d-4bec-8054-3e0a48f3ac8f None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.012209 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cdc9-848d-4bec-8054-3e0a48f3ac8f None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.012300 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cdc9-848d-4bec-8054-3e0a48f3ac8f None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.013974 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 488/993] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:36.019839 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086443-08e6-4db2-b4e0-08941d600e24 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.022074 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086443-08e6-4db2-b4e0-08941d600e24 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.023332 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086443-08e6-4db2-b4e0-08941d600e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.055403 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-bc086443-08e6-4db2-b4e0-08941d600e24 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:36.057151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-bc086443-08e6-4db2-b4e0-08941d600e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:36.079585 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 506/994] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:36.396697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85425-d34e-40b6-9382-757201c4aa75 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.396697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85425-d34e-40b6-9382-757201c4aa75 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.396697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85425-d34e-40b6-9382-757201c4aa75 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.398569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 489/995] 10.222.0.18 () {54 vars in 964 bytes} [Sat Jul 23 20:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:36.407583 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.408724 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.408724 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.452315 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] MFA Rules not processed for user `724caa2823654664b693e9a7edad2539`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:36.453585 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:36.475156 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f28b7-8f7b-4c32-a803-ec25a21e36c4 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.475846 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f28b7-8f7b-4c32-a803-ec25a21e36c4 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.476335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f28b7-8f7b-4c32-a803-ec25a21e36c4 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.478014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 490/996] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:54:36.483522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.483977 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.484271 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.503783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:36.505032 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:36.516313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 491/997] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:36.520767 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 507/998] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Jul 23 20:54:36 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:36.526391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:36.537397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc325d74-b812-43c7-95c1-9396d464eb9d None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:36.542004 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c475f4-1749-4a29-9135-d5bb143b22ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724caa2823654664b693e9a7edad2539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:36.543502 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475f4-1749-4a29-9135-d5bb143b22ee service cinder] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.543752 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475f4-1749-4a29-9135-d5bb143b22ee service cinder] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.544044 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475f4-1749-4a29-9135-d5bb143b22ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.555164 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475f4-1749-4a29-9135-d5bb143b22ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:36.556903 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475f4-1749-4a29-9135-d5bb143b22ee service cinder] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:36.563565 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:36.568265 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 492/999] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:36.576807 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd6a9-d712-4e6b-b9cc-fb0c94283744 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:36.585523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c92a-b399-4b9b-80e8-5205d8c58b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:36.586193 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c92a-b399-4b9b-80e8-5205d8c58b9f service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:36.586475 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c92a-b399-4b9b-80e8-5205d8c58b9f service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:36.586749 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c92a-b399-4b9b-80e8-5205d8c58b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:36.596597 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c92a-b399-4b9b-80e8-5205d8c58b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:36.598235 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c92a-b399-4b9b-80e8-5205d8c58b9f service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:36.602113 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:54:36.610573 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 508/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:39.011197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153992-cf9d-461a-8c56-ee2d5ada3efe None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:39.011685 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153992-cf9d-461a-8c56-ee2d5ada3efe None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:39.011781 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153992-cf9d-461a-8c56-ee2d5ada3efe None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:39.013292 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 493/1001] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:39.018921 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab82c7-21f5-4127-94b3-b65db0906712 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:39.019383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab82c7-21f5-4127-94b3-b65db0906712 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:39.019475 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab82c7-21f5-4127-94b3-b65db0906712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:39.038721 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-22ab82c7-21f5-4127-94b3-b65db0906712 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:39.039925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-22ab82c7-21f5-4127-94b3-b65db0906712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:39.048847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 509/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:39.096314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5153992-cf9d-461a-8c56-ee2d5ada3efe None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:39.111039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5153992-cf9d-461a-8c56-ee2d5ada3efe None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:39.117450 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320681-fec2-4d7b-b1fc-ed17969eef4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:39.118118 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320681-fec2-4d7b-b1fc-ed17969eef4c service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:39.118403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320681-fec2-4d7b-b1fc-ed17969eef4c service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:39.118678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320681-fec2-4d7b-b1fc-ed17969eef4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:39.127977 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320681-fec2-4d7b-b1fc-ed17969eef4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:39.129683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320681-fec2-4d7b-b1fc-ed17969eef4c service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:39.140320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 494/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:41.496708 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb19608-7351-4a6b-8624-f838b0e96726 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:41.497279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb19608-7351-4a6b-8624-f838b0e96726 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:41.497512 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb19608-7351-4a6b-8624-f838b0e96726 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:41.499189 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 510/1004] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:41.505047 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84d3f-e8f8-4e79-87cb-029c21c98b4c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:41.505858 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84d3f-e8f8-4e79-87cb-029c21c98b4c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:41.506391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84d3f-e8f8-4e79-87cb-029c21c98b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:41.525623 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-c2e84d3f-e8f8-4e79-87cb-029c21c98b4c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:41.527250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-c2e84d3f-e8f8-4e79-87cb-029c21c98b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:41.535955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 495/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:54:41.581059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb19608-7351-4a6b-8624-f838b0e96726 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:41.598721 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb19608-7351-4a6b-8624-f838b0e96726 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:41.603945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568ed6a-0a14-4967-af13-15e89ab03acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:41.604587 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568ed6a-0a14-4967-af13-15e89ab03acf service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:41.604997 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568ed6a-0a14-4967-af13-15e89ab03acf service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:41.605333 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568ed6a-0a14-4967-af13-15e89ab03acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:41.614946 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568ed6a-0a14-4967-af13-15e89ab03acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:41.616699 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568ed6a-0a14-4967-af13-15e89ab03acf service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:41.631817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 511/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:43.906084 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab87516-7144-418c-a410-6249bc9b6617 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:43.906640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab87516-7144-418c-a410-6249bc9b6617 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:43.906640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab87516-7144-418c-a410-6249bc9b6617 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:43.907892 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 496/1007] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:43.913521 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbc77c-8781-41de-aa28-c2a1b52e0032 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:43.913945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbc77c-8781-41de-aa28-c2a1b52e0032 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:43.914024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbc77c-8781-41de-aa28-c2a1b52e0032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:43.932267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-51cbc77c-8781-41de-aa28-c2a1b52e0032 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:43.933484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-51cbc77c-8781-41de-aa28-c2a1b52e0032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:43.948332 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 512/1008] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:54:43.999847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab87516-7144-418c-a410-6249bc9b6617 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:44.015311 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab87516-7144-418c-a410-6249bc9b6617 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:44.020854 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ec7e-f5dd-4701-8a7b-f976f1d4efc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:44.021516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ec7e-f5dd-4701-8a7b-f976f1d4efc4 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:44.021803 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ec7e-f5dd-4701-8a7b-f976f1d4efc4 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:44.022072 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ec7e-f5dd-4701-8a7b-f976f1d4efc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:44.031908 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ec7e-f5dd-4701-8a7b-f976f1d4efc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:44.033529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ec7e-f5dd-4701-8a7b-f976f1d4efc4 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:44.043658 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 497/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:46.539340 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d903-d37d-4c24-bfdb-76ad3709ba79 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:46.539953 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d903-d37d-4c24-bfdb-76ad3709ba79 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:46.539953 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d903-d37d-4c24-bfdb-76ad3709ba79 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:46.541457 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 513/1010] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:46.547421 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43443e4-9b13-4aaf-a27d-8fda574c16ba None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:46.547912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43443e4-9b13-4aaf-a27d-8fda574c16ba None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:46.548150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43443e4-9b13-4aaf-a27d-8fda574c16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:46.571943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f43443e4-9b13-4aaf-a27d-8fda574c16ba None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:46.573974 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f43443e4-9b13-4aaf-a27d-8fda574c16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:46.584412 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 498/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:46.642053 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d903-d37d-4c24-bfdb-76ad3709ba79 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:46.658312 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d903-d37d-4c24-bfdb-76ad3709ba79 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:46.665627 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208813a-8665-435c-84ef-f5327fe171cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:46.666488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208813a-8665-435c-84ef-f5327fe171cd service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:46.666829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208813a-8665-435c-84ef-f5327fe171cd service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:46.667173 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208813a-8665-435c-84ef-f5327fe171cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:46.679185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208813a-8665-435c-84ef-f5327fe171cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:46.681349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208813a-8665-435c-84ef-f5327fe171cd service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:46.693524 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 514/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 20:54:49.617037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891de248-a32a-48dc-8393-88bd5759d051 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:49.617799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891de248-a32a-48dc-8393-88bd5759d051 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:49.617799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891de248-a32a-48dc-8393-88bd5759d051 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:49.619040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 499/1013] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:49.624891 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75278-8e3b-4f1f-b69b-05f9fb903523 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:49.625465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75278-8e3b-4f1f-b69b-05f9fb903523 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:49.625465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75278-8e3b-4f1f-b69b-05f9fb903523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:49.649801 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-d8b75278-8e3b-4f1f-b69b-05f9fb903523 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:49.651078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-d8b75278-8e3b-4f1f-b69b-05f9fb903523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:49.660701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 515/1014] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:49.727457 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891de248-a32a-48dc-8393-88bd5759d051 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:49.745379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891de248-a32a-48dc-8393-88bd5759d051 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:49.752340 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab97779-6d9e-4e7f-9190-ce60b2397126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:49.753479 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97779-6d9e-4e7f-9190-ce60b2397126 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:49.753833 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97779-6d9e-4e7f-9190-ce60b2397126 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:49.754202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97779-6d9e-4e7f-9190-ce60b2397126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:49.776640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab97779-6d9e-4e7f-9190-ce60b2397126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:49.776640 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab97779-6d9e-4e7f-9190-ce60b2397126 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:49.791895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 500/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:52.630383 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fec96-2944-4c45-9fd8-02e6142f01d1 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.631146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fec96-2944-4c45-9fd8-02e6142f01d1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.631146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fec96-2944-4c45-9fd8-02e6142f01d1 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.632362 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 516/1016] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:52.638206 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.638811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e165e-6962-4d7b-be0f-f4085da9876d None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.638923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.639020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e165e-6962-4d7b-be0f-f4085da9876d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.639120 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.639210 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e165e-6962-4d7b-be0f-f4085da9876d None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.640343 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 517/1017] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:54:52.645446 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=52 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:54:52.645712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79eee5-a974-4975-b599-fee871322fdb None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.645998 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79eee5-a974-4975-b599-fee871322fdb None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.646270 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79eee5-a974-4975-b599-fee871322fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.659786 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:52.661068 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:52.665035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-0f79eee5-a974-4975-b599-fee871322fdb None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:52.666231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-0f79eee5-a974-4975-b599-fee871322fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:52.669751 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 501/1018] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:52.674296 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 518/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:54:52.721767 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:52.728971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e549a-dc6d-4725-976a-e454c838acbb None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.729250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e549a-dc6d-4725-976a-e454c838acbb None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.729523 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e549a-dc6d-4725-976a-e454c838acbb None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.730916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 519/1020] 10.222.0.18 () {54 vars in 966 bytes} [Sat Jul 23 20:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:54:52.734691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca7700-0c89-4af3-b727-79ae7ad99380 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:52.736433 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561900d-512a-446f-901e-70205e746c2b None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.736856 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561900d-512a-446f-901e-70205e746c2b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.737132 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561900d-512a-446f-901e-70205e746c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.740524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:52.741246 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.741524 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.741793 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.751666 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:52.753341 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:52.763799 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 502/1021] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:52.777338 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-8561900d-512a-446f-901e-70205e746c2b None None] MFA Rules not processed for user `989a9c4b74df4fc1b4a4351652ed499a`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:52.778685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-8561900d-512a-446f-901e-70205e746c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:52.847879 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 520/1022] 10.222.0.18 () {58 vars in 1063 bytes} [Sat Jul 23 20:54:52 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:54:52.855954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:52.866176 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9be2e-d5ac-41b0-8be3-b54283649ab9 service nova] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:52.869924 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449fae6-7608-4054-98c2-59afb6918911 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a9c4b74df4fc1b4a4351652ed499a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:52.870633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449fae6-7608-4054-98c2-59afb6918911 service glance] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:52.870913 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449fae6-7608-4054-98c2-59afb6918911 service glance] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:52.871190 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449fae6-7608-4054-98c2-59afb6918911 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:52.883431 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449fae6-7608-4054-98c2-59afb6918911 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:52.884878 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449fae6-7608-4054-98c2-59afb6918911 service glance] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:52.896683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 503/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:54:55.081826 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ae30-7613-45c2-8321-31bc48f66f24 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:55.082564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ae30-7613-45c2-8321-31bc48f66f24 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:55.082564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ae30-7613-45c2-8321-31bc48f66f24 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:55.083785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 521/1024] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:54:55.089470 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c82e-7da0-4413-a6b2-b70032082d65 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:55.089984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c82e-7da0-4413-a6b2-b70032082d65 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:55.089984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c82e-7da0-4413-a6b2-b70032082d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:55.109376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-a0c9c82e-7da0-4413-a6b2-b70032082d65 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:54:55.110564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-a0c9c82e-7da0-4413-a6b2-b70032082d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:54:55.119391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 504/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:54:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:54:55.166319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ae30-7613-45c2-8321-31bc48f66f24 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:54:55.181129 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ae30-7613-45c2-8321-31bc48f66f24 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:54:55.188533 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571f3dc-91e0-48f8-949e-88bdc7a86d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:54:55.189593 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f3dc-91e0-48f8-949e-88bdc7a86d96 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:54:55.190028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f3dc-91e0-48f8-949e-88bdc7a86d96 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:54:55.190353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f3dc-91e0-48f8-949e-88bdc7a86d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:54:55.199843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571f3dc-91e0-48f8-949e-88bdc7a86d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:54:55.201505 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571f3dc-91e0-48f8-949e-88bdc7a86d96 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:54:55.213331 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 522/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:54:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:05.103122 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=17 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:55:05.206989 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=64 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:55:08.917307 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0dca-ac97-4483-aff4-a1461cbd5a5c None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:08.918066 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0dca-ac97-4483-aff4-a1461cbd5a5c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:08.918066 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0dca-ac97-4483-aff4-a1461cbd5a5c None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:08.919219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 505/1027] 10.222.0.18 () {54 vars in 918 bytes} [Sat Jul 23 20:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:08.924896 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d425bb7-dcc1-49e8-a193-f333fef740a6 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:08.925517 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d425bb7-dcc1-49e8-a193-f333fef740a6 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:08.925517 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d425bb7-dcc1-49e8-a193-f333fef740a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:08.945267 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6d425bb7-dcc1-49e8-a193-f333fef740a6 None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:08.954105 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6d425bb7-dcc1-49e8-a193-f333fef740a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:08.964160 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 523/1028] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Jul 23 20:55:08 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:08.979017 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af449b-0010-411c-8f9b-8c9261d07e13 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:08.979293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af449b-0010-411c-8f9b-8c9261d07e13 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:08.979561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af449b-0010-411c-8f9b-8c9261d07e13 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:08.980978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 506/1029] 10.222.0.18 () {54 vars in 918 bytes} [Sat Jul 23 20:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:08.986054 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda11d6-6345-493d-96ec-a1a8e515f1f5 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:08.986339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda11d6-6345-493d-96ec-a1a8e515f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:08.986616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda11d6-6345-493d-96ec-a1a8e515f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:09.005716 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-5fda11d6-6345-493d-96ec-a1a8e515f1f5 None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:09.006983 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-5fda11d6-6345-493d-96ec-a1a8e515f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:09.016936 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 524/1030] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Jul 23 20:55:08 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:11.767965 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5bb2-3e96-40cf-8edc-c739ba83b77c None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:11.768646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5bb2-3e96-40cf-8edc-c739ba83b77c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:11.768646 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5bb2-3e96-40cf-8edc-c739ba83b77c None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:11.769941 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 507/1031] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:11.776181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eedbf8-7d1a-489c-9cd5-7cdc6a933e06 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:11.776802 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eedbf8-7d1a-489c-9cd5-7cdc6a933e06 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:11.776802 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eedbf8-7d1a-489c-9cd5-7cdc6a933e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:11.796541 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b6eedbf8-7d1a-489c-9cd5-7cdc6a933e06 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:11.797828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b6eedbf8-7d1a-489c-9cd5-7cdc6a933e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:11.806932 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 525/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:11.852467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5bb2-3e96-40cf-8edc-c739ba83b77c None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:11.868001 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5bb2-3e96-40cf-8edc-c739ba83b77c None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:11.873497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bebe4-116b-4f44-bc0c-688a8f00b929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:11.874141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bebe4-116b-4f44-bc0c-688a8f00b929 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:11.874418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bebe4-116b-4f44-bc0c-688a8f00b929 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:11.874688 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bebe4-116b-4f44-bc0c-688a8f00b929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:11.883916 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bebe4-116b-4f44-bc0c-688a8f00b929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:11.885554 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bebe4-116b-4f44-bc0c-688a8f00b929 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:11.895267 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 508/1033] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:12.885828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676f8f-ec12-4b06-9e0e-8e4081da684c None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:12.886485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676f8f-ec12-4b06-9e0e-8e4081da684c None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:12.886485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676f8f-ec12-4b06-9e0e-8e4081da684c None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:12.887769 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 526/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:12.893353 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251f3d-62c0-45cb-b324-b9bd5572c49c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:12.893875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251f3d-62c0-45cb-b324-b9bd5572c49c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:12.893993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251f3d-62c0-45cb-b324-b9bd5572c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:12.913828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-bf251f3d-62c0-45cb-b324-b9bd5572c49c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:12.915039 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-bf251f3d-62c0-45cb-b324-b9bd5572c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:12.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 509/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:13.131811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676f8f-ec12-4b06-9e0e-8e4081da684c None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:13.147846 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676f8f-ec12-4b06-9e0e-8e4081da684c None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:13.153241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb570175-ccc9-41f1-87a4-794192af1e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:13.153902 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb570175-ccc9-41f1-87a4-794192af1e2c service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:13.154176 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb570175-ccc9-41f1-87a4-794192af1e2c service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:13.154441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb570175-ccc9-41f1-87a4-794192af1e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:13.164148 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb570175-ccc9-41f1-87a4-794192af1e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:13.165789 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb570175-ccc9-41f1-87a4-794192af1e2c service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:13.175882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 527/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:14.076262 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea82828-400e-4a8e-a97f-57ef911e44e6 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:14.076863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea82828-400e-4a8e-a97f-57ef911e44e6 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:14.076863 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea82828-400e-4a8e-a97f-57ef911e44e6 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:14.078237 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 510/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:14.083357 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa551e-9ee5-4837-8fb0-d138a9e78948 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:14.083811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa551e-9ee5-4837-8fb0-d138a9e78948 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:14.083912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa551e-9ee5-4837-8fb0-d138a9e78948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:14.102451 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-49fa551e-9ee5-4837-8fb0-d138a9e78948 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:14.103659 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-49fa551e-9ee5-4837-8fb0-d138a9e78948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:14.112091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 528/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:14.267626 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea82828-400e-4a8e-a97f-57ef911e44e6 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:14.282776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea82828-400e-4a8e-a97f-57ef911e44e6 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:14.288299 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411681ff-89b8-47c1-93b5-f7091acac3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:14.288973 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411681ff-89b8-47c1-93b5-f7091acac3b3 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:14.289248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411681ff-89b8-47c1-93b5-f7091acac3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:14.289513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411681ff-89b8-47c1-93b5-f7091acac3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:14.298257 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411681ff-89b8-47c1-93b5-f7091acac3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:14.299867 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411681ff-89b8-47c1-93b5-f7091acac3b3 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:14.310040 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 511/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:15.201606 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b82988-47df-42d8-9d30-8e0c7ebc9a0a None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:15.202190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b82988-47df-42d8-9d30-8e0c7ebc9a0a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:15.202190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b82988-47df-42d8-9d30-8e0c7ebc9a0a None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:15.203585 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 529/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:15.209552 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78db25-5094-4673-857b-5613dfe3602a None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:15.210091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78db25-5094-4673-857b-5613dfe3602a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:15.210091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78db25-5094-4673-857b-5613dfe3602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:15.229608 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-9b78db25-5094-4673-857b-5613dfe3602a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:15.230843 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-9b78db25-5094-4673-857b-5613dfe3602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:15.239925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 512/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:15.396624 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b82988-47df-42d8-9d30-8e0c7ebc9a0a None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:15.412039 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b82988-47df-42d8-9d30-8e0c7ebc9a0a None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:15.418225 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3024d-3bfc-4be8-bdae-dca761ea0d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:15.418881 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3024d-3bfc-4be8-bdae-dca761ea0d9e service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:15.419151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3024d-3bfc-4be8-bdae-dca761ea0d9e service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:15.419450 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3024d-3bfc-4be8-bdae-dca761ea0d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:15.429172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3024d-3bfc-4be8-bdae-dca761ea0d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:15.430803 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3024d-3bfc-4be8-bdae-dca761ea0d9e service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:15.441351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 530/1042] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:16.347311 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5d550-363f-45d8-8388-297087b8293b None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:16.347936 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5d550-363f-45d8-8388-297087b8293b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:16.348099 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5d550-363f-45d8-8388-297087b8293b None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:16.349984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 513/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:16.355787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb017-7423-4df7-9b65-fa32013eb6de None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:16.356438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb017-7423-4df7-9b65-fa32013eb6de None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:16.356438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb017-7423-4df7-9b65-fa32013eb6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:16.374847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-d89cb017-7423-4df7-9b65-fa32013eb6de None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:16.376075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-d89cb017-7423-4df7-9b65-fa32013eb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:16.384425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 531/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:16.538940 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5d550-363f-45d8-8388-297087b8293b None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:16.553300 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5d550-363f-45d8-8388-297087b8293b None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:16.558537 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaea88-6c66-4ee3-a99a-45ad8de610cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:16.559192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaea88-6c66-4ee3-a99a-45ad8de610cb service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:16.559471 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaea88-6c66-4ee3-a99a-45ad8de610cb service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:16.559746 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaea88-6c66-4ee3-a99a-45ad8de610cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:16.569136 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaea88-6c66-4ee3-a99a-45ad8de610cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:16.570739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaea88-6c66-4ee3-a99a-45ad8de610cb service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:16.581360 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 514/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:17.397953 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c6c63-ddcb-4f1e-a831-55fdbb0df4a3 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:17.398584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c6c63-ddcb-4f1e-a831-55fdbb0df4a3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:17.398584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c6c63-ddcb-4f1e-a831-55fdbb0df4a3 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:17.399884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 532/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:17.405690 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ed35-50dd-4ab0-a98d-3ad7aacb8504 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:17.406231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ed35-50dd-4ab0-a98d-3ad7aacb8504 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:17.406231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ed35-50dd-4ab0-a98d-3ad7aacb8504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:17.425322 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-07b6ed35-50dd-4ab0-a98d-3ad7aacb8504 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:17.426602 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-07b6ed35-50dd-4ab0-a98d-3ad7aacb8504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:17.434901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 515/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:17.589297 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c6c63-ddcb-4f1e-a831-55fdbb0df4a3 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:17.604583 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c6c63-ddcb-4f1e-a831-55fdbb0df4a3 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:17.610087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c86b-a32b-412a-b476-baf0711f5f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:17.610727 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c86b-a32b-412a-b476-baf0711f5f6a service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:17.611001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c86b-a32b-412a-b476-baf0711f5f6a service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:17.611268 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c86b-a32b-412a-b476-baf0711f5f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:17.620067 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c86b-a32b-412a-b476-baf0711f5f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:17.621713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c86b-a32b-412a-b476-baf0711f5f6a service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:17.631244 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 533/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:18.459149 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088bff-b5aa-454b-baa1-f03c1ade441d None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:18.459750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088bff-b5aa-454b-baa1-f03c1ade441d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:18.459750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088bff-b5aa-454b-baa1-f03c1ade441d None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:18.461117 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 516/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:18.466259 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdd95-1261-4709-b200-d6f083d970b7 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:18.466707 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdd95-1261-4709-b200-d6f083d970b7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:18.466799 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdd95-1261-4709-b200-d6f083d970b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:18.486422 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6b1fdd95-1261-4709-b200-d6f083d970b7 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:18.487634 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6b1fdd95-1261-4709-b200-d6f083d970b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:18.497092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 534/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:18.651749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088bff-b5aa-454b-baa1-f03c1ade441d None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:18.667948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088bff-b5aa-454b-baa1-f03c1ade441d None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:18.673743 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9221-ed65-40bd-b4c9-c2a519e12048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:18.674387 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9221-ed65-40bd-b4c9-c2a519e12048 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:18.674670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9221-ed65-40bd-b4c9-c2a519e12048 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:18.674945 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9221-ed65-40bd-b4c9-c2a519e12048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:18.683649 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9221-ed65-40bd-b4c9-c2a519e12048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:18.685293 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9221-ed65-40bd-b4c9-c2a519e12048 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:18.695146 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 517/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:19.505949 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039617-5e2e-4b9d-be97-4429f84bad10 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:19.506517 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039617-5e2e-4b9d-be97-4429f84bad10 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:19.506517 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039617-5e2e-4b9d-be97-4429f84bad10 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:19.507843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 535/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:19.513419 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0cb5-5e8f-4689-9e9c-fded13b23953 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:19.513918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0cb5-5e8f-4689-9e9c-fded13b23953 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:19.514009 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0cb5-5e8f-4689-9e9c-fded13b23953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:19.533928 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f83d0cb5-5e8f-4689-9e9c-fded13b23953 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:19.535162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f83d0cb5-5e8f-4689-9e9c-fded13b23953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:19.544688 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 518/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:19.697934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039617-5e2e-4b9d-be97-4429f84bad10 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:19.713494 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039617-5e2e-4b9d-be97-4429f84bad10 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:19.718977 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f4877-4d11-4804-9a26-3c9eea7530d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:19.719605 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4877-4d11-4804-9a26-3c9eea7530d4 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:19.719882 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4877-4d11-4804-9a26-3c9eea7530d4 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:19.720153 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4877-4d11-4804-9a26-3c9eea7530d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:19.728961 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f4877-4d11-4804-9a26-3c9eea7530d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:19.730551 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f4877-4d11-4804-9a26-3c9eea7530d4 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:19.740515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 536/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:20.548756 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0fae-90e0-4cb0-b58a-48a43409d1e2 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:20.549355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0fae-90e0-4cb0-b58a-48a43409d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:20.549355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0fae-90e0-4cb0-b58a-48a43409d1e2 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:20.550749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 519/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:20.555926 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d33b-84c0-4085-93e1-664501c83c71 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:20.556378 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d33b-84c0-4085-93e1-664501c83c71 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:20.556475 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d33b-84c0-4085-93e1-664501c83c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:20.574920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-ae63d33b-84c0-4085-93e1-664501c83c71 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:20.576101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-ae63d33b-84c0-4085-93e1-664501c83c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:20.584447 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 537/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:55:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:20.754960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0fae-90e0-4cb0-b58a-48a43409d1e2 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:20.769943 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0fae-90e0-4cb0-b58a-48a43409d1e2 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:20.775960 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824bdd0-82b6-4016-a123-580c2e8442bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:20.776629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824bdd0-82b6-4016-a123-580c2e8442bc service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:20.776907 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824bdd0-82b6-4016-a123-580c2e8442bc service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:20.777200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824bdd0-82b6-4016-a123-580c2e8442bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:20.786832 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824bdd0-82b6-4016-a123-580c2e8442bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:20.788477 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824bdd0-82b6-4016-a123-580c2e8442bc service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:20.798551 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 520/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:22.890310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18df9b0-d8e9-4ad1-875c-9cbb243a4fbc None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:22.890873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18df9b0-d8e9-4ad1-875c-9cbb243a4fbc None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:22.890873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18df9b0-d8e9-4ad1-875c-9cbb243a4fbc None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:22.892298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 538/1058] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:22.898127 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5493-6424-46e4-a43e-c68475256b6b None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:22.898670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5493-6424-46e4-a43e-c68475256b6b None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:22.898670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5493-6424-46e4-a43e-c68475256b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:22.917973 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-430e5493-6424-46e4-a43e-c68475256b6b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:22.919186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-430e5493-6424-46e4-a43e-c68475256b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:22.928175 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 521/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:22.967971 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18df9b0-d8e9-4ad1-875c-9cbb243a4fbc None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:22.979620 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18df9b0-d8e9-4ad1-875c-9cbb243a4fbc None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:22.983422 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e630a7-6adf-458a-aad7-549b64ac847f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:22.984075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e630a7-6adf-458a-aad7-549b64ac847f service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:22.984355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e630a7-6adf-458a-aad7-549b64ac847f service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:22.984660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e630a7-6adf-458a-aad7-549b64ac847f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:22.994704 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e630a7-6adf-458a-aad7-549b64ac847f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:22.996150 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e630a7-6adf-458a-aad7-549b64ac847f service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:23.006307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 539/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:25.391630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2195-0716-4fe7-a913-bb6bef123137 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:25.392192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2195-0716-4fe7-a913-bb6bef123137 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:25.392192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2195-0716-4fe7-a913-bb6bef123137 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:25.393577 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 522/1061] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:25.398990 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c252077-cebb-44b5-aa59-c690697bd8f7 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:25.399467 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c252077-cebb-44b5-aa59-c690697bd8f7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:25.399564 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c252077-cebb-44b5-aa59-c690697bd8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:25.418622 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-9c252077-cebb-44b5-aa59-c690697bd8f7 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:25.419847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-9c252077-cebb-44b5-aa59-c690697bd8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:25.427895 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 540/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:25.468243 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2195-0716-4fe7-a913-bb6bef123137 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:25.480648 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2195-0716-4fe7-a913-bb6bef123137 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:25.484744 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665592b-ac9f-49c6-bd80-0019a441c9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:25.485429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665592b-ac9f-49c6-bd80-0019a441c9bb service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:25.485729 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665592b-ac9f-49c6-bd80-0019a441c9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:25.485986 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665592b-ac9f-49c6-bd80-0019a441c9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:25.495533 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665592b-ac9f-49c6-bd80-0019a441c9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:25.497012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665592b-ac9f-49c6-bd80-0019a441c9bb service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:25.506794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 523/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:28.173920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fe3d0-c31f-411f-b60d-6e80f96f511f None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:28.174841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fe3d0-c31f-411f-b60d-6e80f96f511f None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:28.174841 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fe3d0-c31f-411f-b60d-6e80f96f511f None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:28.175858 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 541/1064] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:28.181950 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0737-62d6-4853-951c-e16ec345e107 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:28.182424 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0737-62d6-4853-951c-e16ec345e107 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:28.182520 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0737-62d6-4853-951c-e16ec345e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:28.201921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-b34a0737-62d6-4853-951c-e16ec345e107 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:28.203399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-b34a0737-62d6-4853-951c-e16ec345e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:28.212379 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 524/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:28.252705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fe3d0-c31f-411f-b60d-6e80f96f511f None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:28.264307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fe3d0-c31f-411f-b60d-6e80f96f511f None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:28.268030 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd5ee5-b65a-41ac-81b1-02650020e1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:28.268695 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd5ee5-b65a-41ac-81b1-02650020e1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:28.268978 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd5ee5-b65a-41ac-81b1-02650020e1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:28.269289 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd5ee5-b65a-41ac-81b1-02650020e1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:28.278483 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd5ee5-b65a-41ac-81b1-02650020e1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:28.280256 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd5ee5-b65a-41ac-81b1-02650020e1a9 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:28.302139 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 542/1066] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:30.703407 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a21fd5-847e-4a33-8bde-38b96adf9558 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:30.704021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a21fd5-847e-4a33-8bde-38b96adf9558 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:30.704021 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a21fd5-847e-4a33-8bde-38b96adf9558 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:30.705366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 525/1067] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:30.711094 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a45ae-f823-446d-b986-d62af42ba843 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:30.711584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a45ae-f823-446d-b986-d62af42ba843 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:30.711679 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a45ae-f823-446d-b986-d62af42ba843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:30.730996 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-f21a45ae-f823-446d-b986-d62af42ba843 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:30.732243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-f21a45ae-f823-446d-b986-d62af42ba843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:30.741958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 543/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:30.783015 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a21fd5-847e-4a33-8bde-38b96adf9558 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:30.795675 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a21fd5-847e-4a33-8bde-38b96adf9558 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:30.799771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed71a9-17ea-4376-a88e-f809402f007b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:30.800432 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed71a9-17ea-4376-a88e-f809402f007b service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:30.800747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed71a9-17ea-4376-a88e-f809402f007b service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:30.801028 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed71a9-17ea-4376-a88e-f809402f007b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:30.811860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed71a9-17ea-4376-a88e-f809402f007b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:30.813380 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed71a9-17ea-4376-a88e-f809402f007b service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:30.823465 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 526/1069] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:33.134718 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d3f8-c5e3-4ae7-854f-d085b8efec68 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:33.135359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d3f8-c5e3-4ae7-854f-d085b8efec68 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:33.135359 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d3f8-c5e3-4ae7-854f-d085b8efec68 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:33.136717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 544/1070] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:33.142538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1ca5a-7111-4da3-9d3e-c8de70e36fc7 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:33.143199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1ca5a-7111-4da3-9d3e-c8de70e36fc7 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:33.143199 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1ca5a-7111-4da3-9d3e-c8de70e36fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:33.163546 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-6ab1ca5a-7111-4da3-9d3e-c8de70e36fc7 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:33.164869 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-6ab1ca5a-7111-4da3-9d3e-c8de70e36fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:33.173563 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 527/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:55:33.213571 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d3f8-c5e3-4ae7-854f-d085b8efec68 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:33.225651 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d3f8-c5e3-4ae7-854f-d085b8efec68 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:33.229685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c007a80-f831-484b-adbc-b5fae92fe3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:33.230322 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007a80-f831-484b-adbc-b5fae92fe3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:33.230600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007a80-f831-484b-adbc-b5fae92fe3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:33.230871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007a80-f831-484b-adbc-b5fae92fe3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:33.241636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c007a80-f831-484b-adbc-b5fae92fe3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:33.243089 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c007a80-f831-484b-adbc-b5fae92fe3b2 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:33.252943 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 545/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:35.558521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61ef0-45b1-40ac-aaf6-1f66c89f7368 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:35.559148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61ef0-45b1-40ac-aaf6-1f66c89f7368 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:35.559148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61ef0-45b1-40ac-aaf6-1f66c89f7368 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:35.560510 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 528/1073] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:35.565942 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b8b4a-7197-42bd-8244-85d73d488009 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:35.566418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b8b4a-7197-42bd-8244-85d73d488009 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:35.566516 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b8b4a-7197-42bd-8244-85d73d488009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:35.573025 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=70 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:55:35.586070 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-e06b8b4a-7197-42bd-8244-85d73d488009 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:35.587281 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-e06b8b4a-7197-42bd-8244-85d73d488009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:35.595920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 546/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:35.635165 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61ef0-45b1-40ac-aaf6-1f66c89f7368 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:35.640980 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=64 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:55:35.647516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61ef0-45b1-40ac-aaf6-1f66c89f7368 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:35.651461 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87c3a-bfd7-4754-a912-d04c15e54160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:35.652107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87c3a-bfd7-4754-a912-d04c15e54160 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:35.652383 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87c3a-bfd7-4754-a912-d04c15e54160 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:35.652672 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87c3a-bfd7-4754-a912-d04c15e54160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:35.662473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae87c3a-bfd7-4754-a912-d04c15e54160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:35.663888 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae87c3a-bfd7-4754-a912-d04c15e54160 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:35.673691 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 529/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:37.984031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6579f-c29f-4a6b-b1b8-3a41b8cccd43 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:37.984534 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6579f-c29f-4a6b-b1b8-3a41b8cccd43 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:37.984655 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6579f-c29f-4a6b-b1b8-3a41b8cccd43 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:37.986024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 547/1076] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:37.991686 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a1836-6cc0-424c-9e2e-27c54fda2aed None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:37.992105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a1836-6cc0-424c-9e2e-27c54fda2aed None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:37.992222 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a1836-6cc0-424c-9e2e-27c54fda2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:38.011429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-795a1836-6cc0-424c-9e2e-27c54fda2aed None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:38.012653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-795a1836-6cc0-424c-9e2e-27c54fda2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:38.021489 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 530/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:38.060471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6579f-c29f-4a6b-b1b8-3a41b8cccd43 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:38.072415 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6579f-c29f-4a6b-b1b8-3a41b8cccd43 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:38.076701 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9cdfa-6e87-4aa0-831d-3dc616d225ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:38.077353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cdfa-6e87-4aa0-831d-3dc616d225ed service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:38.077635 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cdfa-6e87-4aa0-831d-3dc616d225ed service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:38.077910 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9cdfa-6e87-4aa0-831d-3dc616d225ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:38.087667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9cdfa-6e87-4aa0-831d-3dc616d225ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:38.089174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9cdfa-6e87-4aa0-831d-3dc616d225ed service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:38.098818 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 548/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:40.400812 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d180-081c-4896-871b-5428ebc9fb22 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:40.401428 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d180-081c-4896-871b-5428ebc9fb22 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:40.401428 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d180-081c-4896-871b-5428ebc9fb22 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:40.402827 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 531/1079] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:40.409407 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca5e2-a2d2-4bf1-a701-5ea28056298b None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:40.409981 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca5e2-a2d2-4bf1-a701-5ea28056298b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:40.409981 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca5e2-a2d2-4bf1-a701-5ea28056298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:40.429778 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-5d4ca5e2-a2d2-4bf1-a701-5ea28056298b None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:40.430999 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-5d4ca5e2-a2d2-4bf1-a701-5ea28056298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:40.439847 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 549/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:40.479020 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d180-081c-4896-871b-5428ebc9fb22 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:40.491510 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d180-081c-4896-871b-5428ebc9fb22 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:40.495570 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640373c-bf9f-40c6-bd24-2482215a12f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:40.496218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640373c-bf9f-40c6-bd24-2482215a12f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:40.496496 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640373c-bf9f-40c6-bd24-2482215a12f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:40.496815 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640373c-bf9f-40c6-bd24-2482215a12f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:40.507137 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640373c-bf9f-40c6-bd24-2482215a12f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:40.508516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640373c-bf9f-40c6-bd24-2482215a12f7 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:40.518347 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 532/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:42.791698 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dfafc-4c88-4458-86ba-ecff601255af None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:42.792326 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dfafc-4c88-4458-86ba-ecff601255af None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:42.792326 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dfafc-4c88-4458-86ba-ecff601255af None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:42.793706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 550/1082] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:42.799463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a497f56-ef66-4179-8dc9-10e472f521c0 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:42.799956 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a497f56-ef66-4179-8dc9-10e472f521c0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:42.800062 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a497f56-ef66-4179-8dc9-10e472f521c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:42.818878 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-6a497f56-ef66-4179-8dc9-10e472f521c0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:42.820221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-6a497f56-ef66-4179-8dc9-10e472f521c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:42.829638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 533/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:42.868035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dfafc-4c88-4458-86ba-ecff601255af None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:42.881319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dfafc-4c88-4458-86ba-ecff601255af None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:42.885815 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab3b6-ad6c-4893-badb-149663c4a2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:42.886466 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab3b6-ad6c-4893-badb-149663c4a2ac service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:42.886710 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab3b6-ad6c-4893-badb-149663c4a2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:42.887035 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab3b6-ad6c-4893-badb-149663c4a2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:42.897211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab3b6-ad6c-4893-badb-149663c4a2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:42.898657 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab3b6-ad6c-4893-badb-149663c4a2ac service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:42.909899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 551/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:45.184918 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87ed0-c4c1-4112-804c-bc20382ac680 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:45.185568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87ed0-c4c1-4112-804c-bc20382ac680 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:45.185568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87ed0-c4c1-4112-804c-bc20382ac680 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:45.186839 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 534/1085] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 20:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:55:45.193301 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f267903-2bbe-4f5f-a6f6-1700e9b6b40d None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:45.193890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f267903-2bbe-4f5f-a6f6-1700e9b6b40d None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:45.193890 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f267903-2bbe-4f5f-a6f6-1700e9b6b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:45.213073 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-3f267903-2bbe-4f5f-a6f6-1700e9b6b40d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:55:45.214321 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-3f267903-2bbe-4f5f-a6f6-1700e9b6b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:55:45.223066 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 552/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 20:55:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:55:45.262231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87ed0-c4c1-4112-804c-bc20382ac680 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:55:45.274145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87ed0-c4c1-4112-804c-bc20382ac680 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:55:45.278089 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177a047-b596-46a0-b82d-4712e07d8404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:55:45.279100 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177a047-b596-46a0-b82d-4712e07d8404 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:55:45.279374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177a047-b596-46a0-b82d-4712e07d8404 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:55:45.279647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177a047-b596-46a0-b82d-4712e07d8404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:55:45.290076 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177a047-b596-46a0-b82d-4712e07d8404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:55:45.291530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177a047-b596-46a0-b82d-4712e07d8404 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:55:45.302208 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 535/1087] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:55:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:55:55.207292 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=20 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:55:55.297476 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=23 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:09.168163 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05e8-cd96-4ffa-b831-9e8b0ebc2d34 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:09.168825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05e8-cd96-4ffa-b831-9e8b0ebc2d34 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:09.168825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05e8-cd96-4ffa-b831-9e8b0ebc2d34 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:09.170914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 553/1088] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:09.177429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d90c0c-12bd-449d-9f44-f0a43e46b9b0 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:09.178229 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d90c0c-12bd-449d-9f44-f0a43e46b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:09.178407 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d90c0c-12bd-449d-9f44-f0a43e46b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:09.198791 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-59d90c0c-12bd-449d-9f44-f0a43e46b9b0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:09.200014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-59d90c0c-12bd-449d-9f44-f0a43e46b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:09.209166 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 536/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:09.260438 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899002d-37f0-494e-bf1b-c44d3f5e5f00 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:09.260750 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899002d-37f0-494e-bf1b-c44d3f5e5f00 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:09.261022 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899002d-37f0-494e-bf1b-c44d3f5e5f00 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:09.262392 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 554/1090] 10.222.0.18 () {54 vars in 966 bytes} [Sat Jul 23 20:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:09.268389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c31d9-a4a9-47dd-9212-941e5aafb59a None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:09.268727 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c31d9-a4a9-47dd-9212-941e5aafb59a None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:09.269000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c31d9-a4a9-47dd-9212-941e5aafb59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:09.289714 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-fb5c31d9-a4a9-47dd-9212-941e5aafb59a None None] MFA Rules not processed for user `989a9c4b74df4fc1b4a4351652ed499a`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:09.290998 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-fb5c31d9-a4a9-47dd-9212-941e5aafb59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:09.298361 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 537/1091] 10.222.0.18 () {58 vars in 1063 bytes} [Sat Jul 23 20:56:09 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:09.306725 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899002d-37f0-494e-bf1b-c44d3f5e5f00 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:09.324616 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899002d-37f0-494e-bf1b-c44d3f5e5f00 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:09.325088 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4f6f6-c72a-4666-9820-2f6ae060a14b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a9c4b74df4fc1b4a4351652ed499a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:09.325586 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4f6f6-c72a-4666-9820-2f6ae060a14b service glance] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:09.325870 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4f6f6-c72a-4666-9820-2f6ae060a14b service glance] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:09.326146 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4f6f6-c72a-4666-9820-2f6ae060a14b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:09.336700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4f6f6-c72a-4666-9820-2f6ae060a14b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:09.338198 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4f6f6-c72a-4666-9820-2f6ae060a14b service glance] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:09.349397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 555/1092] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:56:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:56:11.732493 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c74e-25c7-4e9b-be98-4d7d4bf701f0 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:11.733195 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c74e-25c7-4e9b-be98-4d7d4bf701f0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:11.733195 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c74e-25c7-4e9b-be98-4d7d4bf701f0 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:11.734673 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 538/1093] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:11.740560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2b4a-4e20-40b6-b581-95223311ac33 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:11.741101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2b4a-4e20-40b6-b581-95223311ac33 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:11.741101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2b4a-4e20-40b6-b581-95223311ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:11.759797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-e2cd2b4a-4e20-40b6-b581-95223311ac33 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:11.761031 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-e2cd2b4a-4e20-40b6-b581-95223311ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:11.770078 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 556/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30c74e-25c7-4e9b-be98-4d7d4bf701f0 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:11.810027 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30c74e-25c7-4e9b-be98-4d7d4bf701f0 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:11.815475 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:11.816157 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:11.816435 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:11.816742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:11.817532 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:11.819418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:56:11.819418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 20:56:11.819418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 20:56:11.820565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff149f24-7218-4e6b-b59b-47895d32f9f8 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:11.841026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 539/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:11 2022] GET /identity/v3/projects => generated 1606 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:56:14.120309 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e52f82-d42d-46e3-8330-fc3f05708a70 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:14.120935 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e52f82-d42d-46e3-8330-fc3f05708a70 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:14.120935 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e52f82-d42d-46e3-8330-fc3f05708a70 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:14.122367 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 557/1096] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:14.128176 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5845e9-9c95-4ed9-a806-24c7404d8719 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:14.128653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5845e9-9c95-4ed9-a806-24c7404d8719 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:14.128783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5845e9-9c95-4ed9-a806-24c7404d8719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:14.147543 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-8f5845e9-9c95-4ed9-a806-24c7404d8719 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:14.148797 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-8f5845e9-9c95-4ed9-a806-24c7404d8719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:14.158157 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 540/1097] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:14.202354 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e52f82-d42d-46e3-8330-fc3f05708a70 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:14.216775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e52f82-d42d-46e3-8330-fc3f05708a70 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:14.222100 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb75b5-4d26-4ff6-bf83-eba88f8831c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:14.222777 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb75b5-4d26-4ff6-bf83-eba88f8831c6 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:14.223058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb75b5-4d26-4ff6-bf83-eba88f8831c6 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:14.223316 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb75b5-4d26-4ff6-bf83-eba88f8831c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:14.233418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb75b5-4d26-4ff6-bf83-eba88f8831c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:14.235191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb75b5-4d26-4ff6-bf83-eba88f8831c6 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:14.247939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 558/1098] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:56:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:56:16.696565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e2dd-bf5c-462c-b1d3-c5caebfb8942 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:16.697226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e2dd-bf5c-462c-b1d3-c5caebfb8942 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:16.697226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e2dd-bf5c-462c-b1d3-c5caebfb8942 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:16.698509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 541/1099] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:16.704437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d9fd9-1603-4c18-9f27-44423bff3fe0 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:16.704978 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d9fd9-1603-4c18-9f27-44423bff3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:16.704978 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d9fd9-1603-4c18-9f27-44423bff3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:16.725374 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-2d2d9fd9-1603-4c18-9f27-44423bff3fe0 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:16.726694 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-2d2d9fd9-1603-4c18-9f27-44423bff3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:16.736002 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 559/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:16.775455 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45e2dd-bf5c-462c-b1d3-c5caebfb8942 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:16.788564 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45e2dd-bf5c-462c-b1d3-c5caebfb8942 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:16.792753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e46e5-3417-47af-bc1e-17ec0f7407e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:16.793424 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e46e5-3417-47af-bc1e-17ec0f7407e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:16.793668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e46e5-3417-47af-bc1e-17ec0f7407e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:16.793937 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e46e5-3417-47af-bc1e-17ec0f7407e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:16.804732 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e46e5-3417-47af-bc1e-17ec0f7407e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:16.806192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e46e5-3417-47af-bc1e-17ec0f7407e2 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:16.817053 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 542/1101] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:56:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:56:19.128636 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf364d-6d53-4a23-a25d-d5c97f2f1234 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:19.129273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf364d-6d53-4a23-a25d-d5c97f2f1234 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:19.129273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf364d-6d53-4a23-a25d-d5c97f2f1234 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:19.130608 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 560/1102] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:19.136259 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70364f-502b-4cb2-96ae-19533db1cb64 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:19.136749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70364f-502b-4cb2-96ae-19533db1cb64 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:19.136859 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70364f-502b-4cb2-96ae-19533db1cb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:19.156272 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-8d70364f-502b-4cb2-96ae-19533db1cb64 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:19.157531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-8d70364f-502b-4cb2-96ae-19533db1cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:19.166578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 543/1103] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:19.206116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf364d-6d53-4a23-a25d-d5c97f2f1234 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:19.218203 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf364d-6d53-4a23-a25d-d5c97f2f1234 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:19.222021 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329addd-22e2-4a81-ae12-aa21efa236f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:19.222662 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329addd-22e2-4a81-ae12-aa21efa236f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:19.222948 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329addd-22e2-4a81-ae12-aa21efa236f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:19.223224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329addd-22e2-4a81-ae12-aa21efa236f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:19.232860 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329addd-22e2-4a81-ae12-aa21efa236f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:19.234325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329addd-22e2-4a81-ae12-aa21efa236f7 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:19.244639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 561/1104] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:56:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:56:21.668331 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c3d3-5556-4126-93cc-7d2c7a0b976d None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:21.668952 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c3d3-5556-4126-93cc-7d2c7a0b976d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:21.669182 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c3d3-5556-4126-93cc-7d2c7a0b976d None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:21.671447 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 544/1105] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:21.677418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0115c-0286-4e41-b2c0-c3ce56fc6777 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:21.677917 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0115c-0286-4e41-b2c0-c3ce56fc6777 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:21.677917 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0115c-0286-4e41-b2c0-c3ce56fc6777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:21.695884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-70a0115c-0286-4e41-b2c0-c3ce56fc6777 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:21.697138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-70a0115c-0286-4e41-b2c0-c3ce56fc6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:21.705774 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 562/1106] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:21.747806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6c3d3-5556-4126-93cc-7d2c7a0b976d None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:21.760267 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6c3d3-5556-4126-93cc-7d2c7a0b976d None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:21.764235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8efa24-0f4f-435e-bc95-e3fa2c224a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:21.764912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8efa24-0f4f-435e-bc95-e3fa2c224a96 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:21.765191 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8efa24-0f4f-435e-bc95-e3fa2c224a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:21.765531 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8efa24-0f4f-435e-bc95-e3fa2c224a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:21.775897 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8efa24-0f4f-435e-bc95-e3fa2c224a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:21.777776 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8efa24-0f4f-435e-bc95-e3fa2c224a96 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:21.787750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 545/1107] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:56:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:56:24.220776 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54efd-ed08-4990-bda6-4b9eef10c588 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:24.221418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54efd-ed08-4990-bda6-4b9eef10c588 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:24.221418 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54efd-ed08-4990-bda6-4b9eef10c588 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:24.222779 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 563/1108] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jul 23 20:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:24.228207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812180-1783-4d3a-a372-afa9497af987 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:24.228690 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812180-1783-4d3a-a372-afa9497af987 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:24.228811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812180-1783-4d3a-a372-afa9497af987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:24.247914 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-40812180-1783-4d3a-a372-afa9497af987 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:24.249095 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-40812180-1783-4d3a-a372-afa9497af987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:24.258615 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 546/1109] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:56:24.299099 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54efd-ed08-4990-bda6-4b9eef10c588 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:24.310539 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54efd-ed08-4990-bda6-4b9eef10c588 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:24.314501 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac368352-cb70-402b-8221-0330cdea505e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:24.315138 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368352-cb70-402b-8221-0330cdea505e service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:24.315435 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368352-cb70-402b-8221-0330cdea505e service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:24.315697 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368352-cb70-402b-8221-0330cdea505e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:24.324851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac368352-cb70-402b-8221-0330cdea505e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:24.326289 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac368352-cb70-402b-8221-0330cdea505e service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:24.335781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 564/1110] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:56:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:56:34.242250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=33 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:34.331869 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=33 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.333983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.334625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.334625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.354150 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:05.355397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:05.364491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 547/1111] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:58:05.373404 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.374089 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.374199 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.397637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:05.399253 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:05.409018 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 565/1112] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:58:05.415909 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.426678 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f376c-1017-4bbe-b536-dbcd8dfcdf3d None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.433119 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.433806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.434091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.434366 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.435109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:05.435413 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.436538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:05.436538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 20:58:05.436538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 20:58:05.437490 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.451070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 548/1113] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:05.459995 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.471179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c50746-16eb-4da7-9918-a3818d8ec7d6 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.476479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.477241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.477496 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.477796 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.478530 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.480455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:05.480455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 20:58:05.480455 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 20:58:05.481722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.511518 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 566/1114] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:05.516314 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.527783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c1a8-bd2e-47da-885d-33fc59fb3613 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.587573 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.588257 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.588541 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.588864 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.589578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.590603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:05.590603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 20:58:05.590603 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 20:58:05.591877 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.614709 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 549/1115] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:05.619458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.636218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328bfa4-d416-4710-9a91-481962c04309 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.644130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.645349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.645859 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.646360 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.647761 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.650023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:05.650023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 20:58:05.650023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 20:58:05.651765 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.670375 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 567/1116] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:58:05.675699 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.688113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f174417-c1db-4f63-a237-0d4bc43babe5 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.694469 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.695179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.695449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.695726 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.696464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.697556 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:05.697556 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 20:58:05.697556 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 20:58:05.698458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec0d26-9720-4a6a-8924-b95d4220ce64 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.714066 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 550/1117] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:58:05.721311 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.738664 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17b12-18a1-4252-bb31-3a1ebe8e6366 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.747919 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.749715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.750293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.750640 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] PATH_INFO: `/v3/projects/d9b52229dfd946bf961a6e71edf328d7/users/89c6ae6fee844461b956ddf394441659/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.775609 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b52229dfd946bf961a6e71edf328d7, user_id=89c6ae6fee844461b956ddf394441659, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.777862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:05.777862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 20:58:05.777862 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 20:58:05.781190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135a5b1-e258-431d-b808-dea0fb59ca8b admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.800504 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 568/1118] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 20:58:05 2022] PUT /identity/v3/projects/d9b52229dfd946bf961a6e71edf328d7/users/89c6ae6fee844461b956ddf394441659/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:05.813967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806519f0-265f-44aa-83f9-74a90d5a74ee None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.814255 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806519f0-265f-44aa-83f9-74a90d5a74ee None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.814521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806519f0-265f-44aa-83f9-74a90d5a74ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.847346 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-806519f0-265f-44aa-83f9-74a90d5a74ee None None] MFA Rules not processed for user `89c6ae6fee844461b956ddf394441659`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:05.848591 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-806519f0-265f-44aa-83f9-74a90d5a74ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:05.917091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 551/1119] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:58:05.931481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab070-7be0-4d1f-b159-051529e0ce87 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.931897 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab070-7be0-4d1f-b159-051529e0ce87 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.932260 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab070-7be0-4d1f-b159-051529e0ce87 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.933973 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 569/1120] 10.222.0.18 () {54 vars in 964 bytes} [Sat Jul 23 20:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:05.939614 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08b05-7172-4c7e-afc5-cf94e28f9be5 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.939901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08b05-7172-4c7e-afc5-cf94e28f9be5 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.940183 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08b05-7172-4c7e-afc5-cf94e28f9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.959948 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-e3e08b05-7172-4c7e-afc5-cf94e28f9be5 None None] MFA Rules not processed for user `724caa2823654664b693e9a7edad2539`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:05.961222 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e3e08b05-7172-4c7e-afc5-cf94e28f9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:06.015809 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.025528 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 552/1121] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:58:06.033545 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab070-7be0-4d1f-b159-051529e0ce87 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.044970 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab070-7be0-4d1f-b159-051529e0ce87 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.048575 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724caa2823654664b693e9a7edad2539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.049248 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.049522 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.049799 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.058800 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.060296 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.075290 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 570/1122] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:58:06.113946 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448efbc-b4e6-43d8-8b4d-bd8d59ea3565 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.114235 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448efbc-b4e6-43d8-8b4d-bd8d59ea3565 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.114513 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448efbc-b4e6-43d8-8b4d-bd8d59ea3565 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.116063 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 553/1123] 10.222.0.18 () {52 vars in 829 bytes} [Sat Jul 23 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:06.120108 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.185217 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64d84f-e4b5-4076-804c-14403c59ff82 service cinder] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.190223 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.191108 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.191389 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.191658 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] PATH_INFO: `/v3/users/89c6ae6fee844461b956ddf394441659` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.192946 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c6ae6fee844461b956ddf394441659)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.193974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:06.193974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 20:58:06.193974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 20:58:06.195181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.265343 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c6ae6fee844461b956ddf394441659'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:06.284918 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c6ae6fee844461b956ddf394441659'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:06.285585 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c6ae6fee844461b956ddf394441659'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:06.286287 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c6ae6fee844461b956ddf394441659'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:06.297236 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c6ae6fee844461b956ddf394441659'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:06.317766 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 571/1124] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jul 23 20:58:06 2022] DELETE /identity/v3/users/89c6ae6fee844461b956ddf394441659 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:58:06.322349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.322617 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.322900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.341886 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:06.343140 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:06.419519 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 554/1125] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 20:58:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:58:06.430305 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.432265 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:06.438048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.504157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d644675-1ef1-4cc0-83c5-afb9db9f2328 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.508349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f86e5-16fb-4c00-8e3f-cfde9e69fe0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.509293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f86e5-16fb-4c00-8e3f-cfde9e69fe0d service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.509293 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f86e5-16fb-4c00-8e3f-cfde9e69fe0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.509663 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f86e5-16fb-4c00-8e3f-cfde9e69fe0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.520915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f86e5-16fb-4c00-8e3f-cfde9e69fe0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.522404 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f86e5-16fb-4c00-8e3f-cfde9e69fe0d service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.533484 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 572/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:58:06.886229 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.888659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:06.910507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998fb2-c48e-4e31-92d3-7d941bbfde96 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.916932 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.917983 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.918391 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.918574 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] PATH_INFO: `/v3/projects/d9b52229dfd946bf961a6e71edf328d7` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.920395 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b52229dfd946bf961a6e71edf328d7)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.921622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 20:58:06.921622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 20:58:06.921622 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 20:58:06.922964 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.024023 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b52229dfd946bf961a6e71edf328d7', 'request_id': 'req-97674cf3-17bd-45e1-8282-9e693384b48f'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:07.048257 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b52229dfd946bf961a6e71edf328d7', 'request_id': 'req-97674cf3-17bd-45e1-8282-9e693384b48f'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:07.064858 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b52229dfd946bf961a6e71edf328d7', 'request_id': 'req-97674cf3-17bd-45e1-8282-9e693384b48f'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:07.084177 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] The token cache is being invalidate because project d9b52229dfd946bf961a6e71edf328d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 20:58:07.084702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:07.085778 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-97674cf3-17bd-45e1-8282-9e693384b48f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 20:58:07.088474 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 555/1127] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jul 23 20:58:06 2022] DELETE /identity/v3/projects/d9b52229dfd946bf961a6e71edf328d7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:16.528589 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=25 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:17.078202 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:31.124317 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503079f3-bc40-49bb-97e5-ced029367393 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:31.125001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503079f3-bc40-49bb-97e5-ced029367393 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:31.125001 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503079f3-bc40-49bb-97e5-ced029367393 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:31.126335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:31.137284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2c10-651e-4dcd-b3a5-f40ee224b42c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:31.137762 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2c10-651e-4dcd-b3a5-f40ee224b42c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:31.137861 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2c10-651e-4dcd-b3a5-f40ee224b42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:31.209073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-141c2c10-651e-4dcd-b3a5-f40ee224b42c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:31.210369 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-141c2c10-651e-4dcd-b3a5-f40ee224b42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:31.308551 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:59:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:31.479009 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503079f3-bc40-49bb-97e5-ced029367393 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:31.480809 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-503079f3-bc40-49bb-97e5-ced029367393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:31.570811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503079f3-bc40-49bb-97e5-ced029367393 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:31.576179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3faf-89ab-44dc-afe6-2e5ad8040162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:31.576939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3faf-89ab-44dc-afe6-2e5ad8040162 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:31.577219 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3faf-89ab-44dc-afe6-2e5ad8040162 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:31.577493 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3faf-89ab-44dc-afe6-2e5ad8040162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:31.586132 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a3faf-89ab-44dc-afe6-2e5ad8040162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:31.587746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a3faf-89ab-44dc-afe6-2e5ad8040162 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:31.597335 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 574/1130] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:59:32.442355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9035f-a256-4e87-b6f7-66b4c9bc3682 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:32.442906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9035f-a256-4e87-b6f7-66b4c9bc3682 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:32.442906 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9035f-a256-4e87-b6f7-66b4c9bc3682 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:32.444190 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:32.449986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db5b6-53a6-475a-8ba3-c9287334b4d1 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:32.450567 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db5b6-53a6-475a-8ba3-c9287334b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:32.450672 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db5b6-53a6-475a-8ba3-c9287334b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:32.469911 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-349db5b6-53a6-475a-8ba3-c9287334b4d1 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:32.471176 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-349db5b6-53a6-475a-8ba3-c9287334b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:32.479785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:59:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:32.639848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9035f-a256-4e87-b6f7-66b4c9bc3682 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:32.654766 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9035f-a256-4e87-b6f7-66b4c9bc3682 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:32.660277 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90a6c-8aab-46b9-8d1f-4c4280e12629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:32.660980 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90a6c-8aab-46b9-8d1f-4c4280e12629 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:32.661258 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90a6c-8aab-46b9-8d1f-4c4280e12629 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:32.661533 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90a6c-8aab-46b9-8d1f-4c4280e12629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:32.670263 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90a6c-8aab-46b9-8d1f-4c4280e12629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:32.671882 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90a6c-8aab-46b9-8d1f-4c4280e12629 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:32.681961 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 558/1133] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:59:37.111319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b05a-ee25-466c-9ca9-803039b79ea6 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:37.111916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b05a-ee25-466c-9ca9-803039b79ea6 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:37.111916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b05a-ee25-466c-9ca9-803039b79ea6 None None] PATH_INFO: `/v3` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:37.113274 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 576/1134] 10.222.0.36 () {54 vars in 925 bytes} [Sat Jul 23 20:59:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:37.127057 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed2b89-5709-4e76-86c6-10a46ead99a2 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:37.127650 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed2b89-5709-4e76-86c6-10a46ead99a2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:37.127650 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed2b89-5709-4e76-86c6-10a46ead99a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:37.161509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-baed2b89-5709-4e76-86c6-10a46ead99a2 None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:37.162755 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-baed2b89-5709-4e76-86c6-10a46ead99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:37.223123 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=100 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:37.233692 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 559/1135] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Jul 23 20:59:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:42.464934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=42 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:43.961488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae9ccb-88c6-45d5-955a-21e9ac36404e None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:43.962195 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae9ccb-88c6-45d5-955a-21e9ac36404e None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:43.962195 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae9ccb-88c6-45d5-955a-21e9ac36404e None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:43.963482 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 577/1136] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:43.968759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab347c-37d5-4acd-8754-9c1ad96efed4 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:43.969216 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab347c-37d5-4acd-8754-9c1ad96efed4 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:43.969318 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab347c-37d5-4acd-8754-9c1ad96efed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:43.990132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-e2ab347c-37d5-4acd-8754-9c1ad96efed4 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:43.991355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e2ab347c-37d5-4acd-8754-9c1ad96efed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:43.999996 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 560/1137] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:59:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 20:59:44.158460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae9ccb-88c6-45d5-955a-21e9ac36404e None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:44.173479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae9ccb-88c6-45d5-955a-21e9ac36404e None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:44.178666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e42c-af7b-4043-a72b-096d5faebd08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:44.179319 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e42c-af7b-4043-a72b-096d5faebd08 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:44.179599 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e42c-af7b-4043-a72b-096d5faebd08 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:44.179874 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e42c-af7b-4043-a72b-096d5faebd08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:44.188867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e42c-af7b-4043-a72b-096d5faebd08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:44.190498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e42c-af7b-4043-a72b-096d5faebd08 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:44.200266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 578/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:59:45.045467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52725a0d-3aa3-41d9-ad55-479cd006da51 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:45.046113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52725a0d-3aa3-41d9-ad55-479cd006da51 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:45.046113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52725a0d-3aa3-41d9-ad55-479cd006da51 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:45.047399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 561/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:45.052572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37095e-6673-48e7-8c95-d3a3d7748261 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:45.053079 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37095e-6673-48e7-8c95-d3a3d7748261 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:45.053180 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37095e-6673-48e7-8c95-d3a3d7748261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:45.072575 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-8d37095e-6673-48e7-8c95-d3a3d7748261 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:45.073848 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-8d37095e-6673-48e7-8c95-d3a3d7748261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:45.082682 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 579/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:59:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:45.242409 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52725a0d-3aa3-41d9-ad55-479cd006da51 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:45.258171 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52725a0d-3aa3-41d9-ad55-479cd006da51 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:45.264352 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96a4a-d906-4931-9e82-c9bc2eb86481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:45.265088 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96a4a-d906-4931-9e82-c9bc2eb86481 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:45.265355 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96a4a-d906-4931-9e82-c9bc2eb86481 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:45.265627 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96a4a-d906-4931-9e82-c9bc2eb86481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:45.275342 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96a4a-d906-4931-9e82-c9bc2eb86481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:45.277029 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96a4a-d906-4931-9e82-c9bc2eb86481 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:45.287783 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 562/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:59:46.382596 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa986-981b-4dc2-9b97-e6cfb53206fa None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:46.383184 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa986-981b-4dc2-9b97-e6cfb53206fa None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:46.383184 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa986-981b-4dc2-9b97-e6cfb53206fa None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:46.384406 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 580/1142] 10.222.0.18 () {54 vars in 961 bytes} [Sat Jul 23 20:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:46.389747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eaaa5-a584-4201-b72f-95080a16fa3e None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:46.390180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eaaa5-a584-4201-b72f-95080a16fa3e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:46.390297 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eaaa5-a584-4201-b72f-95080a16fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:46.410104 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-1b8eaaa5-a584-4201-b72f-95080a16fa3e None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:46.411329 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-1b8eaaa5-a584-4201-b72f-95080a16fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:46.420066 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 563/1143] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jul 23 20:59:46 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:46.428034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aa986-981b-4dc2-9b97-e6cfb53206fa None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:46.443372 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aa986-981b-4dc2-9b97-e6cfb53206fa None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:46.449019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba86d0-b920-41f0-8f6f-f47be7ece039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:46.449695 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba86d0-b920-41f0-8f6f-f47be7ece039 service placement] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:46.449968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba86d0-b920-41f0-8f6f-f47be7ece039 service placement] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:46.450222 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba86d0-b920-41f0-8f6f-f47be7ece039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:46.458520 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba86d0-b920-41f0-8f6f-f47be7ece039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:46.460115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba86d0-b920-41f0-8f6f-f47be7ece039 service placement] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:46.469818 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 581/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:59:56.404795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=12 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:56.465861 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=15 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:56.564397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21807fd7-bdcf-4ee2-845b-e28469e2144f None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:56.564722 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21807fd7-bdcf-4ee2-845b-e28469e2144f None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:56.564981 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21807fd7-bdcf-4ee2-845b-e28469e2144f None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:56.566358 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 564/1145] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:56.571830 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a785cdc-441c-4d5f-8098-b363d104c42a None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:56.572116 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a785cdc-441c-4d5f-8098-b363d104c42a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:56.572392 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a785cdc-441c-4d5f-8098-b363d104c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:56.591764 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-0a785cdc-441c-4d5f-8098-b363d104c42a None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:56.593108 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-0a785cdc-441c-4d5f-8098-b363d104c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:56.602626 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 582/1146] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:59:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:56.762650 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21807fd7-bdcf-4ee2-845b-e28469e2144f None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:56.777489 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21807fd7-bdcf-4ee2-845b-e28469e2144f None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:56.782753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3895159-391b-4757-80ad-75051e7667d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:56.783404 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3895159-391b-4757-80ad-75051e7667d8 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:56.783683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3895159-391b-4757-80ad-75051e7667d8 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:56.783957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3895159-391b-4757-80ad-75051e7667d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:56.793109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3895159-391b-4757-80ad-75051e7667d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:56.794705 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3895159-391b-4757-80ad-75051e7667d8 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:56.807144 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 565/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 20:59:57.626251 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e25ff-d333-4ddd-a349-36410370bc5b None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:57.626883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e25ff-d333-4ddd-a349-36410370bc5b None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:57.626883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e25ff-d333-4ddd-a349-36410370bc5b None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:57.628260 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 583/1148] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 20:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:57.634200 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdf874-1d14-4555-804b-a58199eb418c None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:57.634795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdf874-1d14-4555-804b-a58199eb418c None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:57.634795 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdf874-1d14-4555-804b-a58199eb418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:57.654842 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-7ccdf874-1d14-4555-804b-a58199eb418c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:57.656094 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-7ccdf874-1d14-4555-804b-a58199eb418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:57.664900 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 566/1149] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 20:59:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 20:59:57.819494 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e25ff-d333-4ddd-a349-36410370bc5b None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:57.835431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e25ff-d333-4ddd-a349-36410370bc5b None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:57.841049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18625-9ff9-4a5b-8ad4-ee9ac24a574a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:57.841703 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18625-9ff9-4a5b-8ad4-ee9ac24a574a service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:57.841986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18625-9ff9-4a5b-8ad4-ee9ac24a574a service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:57.842377 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18625-9ff9-4a5b-8ad4-ee9ac24a574a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:57.851849 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18625-9ff9-4a5b-8ad4-ee9ac24a574a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:57.853560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18625-9ff9-4a5b-8ad4-ee9ac24a574a service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:57.864107 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 584/1150] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 20:59:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:00:02.109802 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db0c2-c592-4cba-ad96-60da91d7a70e None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:02.110420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db0c2-c592-4cba-ad96-60da91d7a70e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:02.110420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db0c2-c592-4cba-ad96-60da91d7a70e None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:02.111707 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 567/1151] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:00:02.117580 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0869e8-e2a6-4ed2-b578-317be7ed51ee None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:02.118045 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0869e8-e2a6-4ed2-b578-317be7ed51ee None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:02.118157 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0869e8-e2a6-4ed2-b578-317be7ed51ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:02.137986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-4f0869e8-e2a6-4ed2-b578-317be7ed51ee None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:00:02.139266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4f0869e8-e2a6-4ed2-b578-317be7ed51ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:02.148956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 585/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:00:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:00:02.187642 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db0c2-c592-4cba-ad96-60da91d7a70e None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:02.189747 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-9a8db0c2-c592-4cba-ad96-60da91d7a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:02.253198 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db0c2-c592-4cba-ad96-60da91d7a70e None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:02.257676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edcae1-3bd5-4a87-b819-f13219e3b50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:02.258335 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edcae1-3bd5-4a87-b819-f13219e3b50d service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:02.258616 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edcae1-3bd5-4a87-b819-f13219e3b50d service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:02.258883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edcae1-3bd5-4a87-b819-f13219e3b50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:02.269702 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edcae1-3bd5-4a87-b819-f13219e3b50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:02.271239 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edcae1-3bd5-4a87-b819-f13219e3b50d service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:02.282565 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 568/1153] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:00:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:00:04.557657 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d45bf1-1147-4dc3-9764-a161d44ed39a None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:04.558240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d45bf1-1147-4dc3-9764-a161d44ed39a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:04.558240 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d45bf1-1147-4dc3-9764-a161d44ed39a None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:04.559632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 586/1154] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:00:04.565823 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebff70-e73d-43e4-a4b9-530edd11fb9d None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:04.566334 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebff70-e73d-43e4-a4b9-530edd11fb9d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:04.566334 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebff70-e73d-43e4-a4b9-530edd11fb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:04.585676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-09ebff70-e73d-43e4-a4b9-530edd11fb9d None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:00:04.586911 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-09ebff70-e73d-43e4-a4b9-530edd11fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:04.595759 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 569/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:00:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:00:04.633975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d45bf1-1147-4dc3-9764-a161d44ed39a None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:04.647630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d45bf1-1147-4dc3-9764-a161d44ed39a None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:04.651248 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c695c9-ca92-4310-bca6-896564f205af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:04.652191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c695c9-ca92-4310-bca6-896564f205af service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:04.652191 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c695c9-ca92-4310-bca6-896564f205af service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:04.652639 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c695c9-ca92-4310-bca6-896564f205af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:04.662667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c695c9-ca92-4310-bca6-896564f205af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:04.664158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c695c9-ca92-4310-bca6-896564f205af service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:04.674866 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 587/1156] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:00:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:00:08.473448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a6ce-3029-40ac-a5e2-b3dc455a7484 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:08.474102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a6ce-3029-40ac-a5e2-b3dc455a7484 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:08.474102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a6ce-3029-40ac-a5e2-b3dc455a7484 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:08.475742 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 570/1157] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:00:08.482185 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b839d-1e3e-4582-bb08-7df66fa1ba51 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:08.482742 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b839d-1e3e-4582-bb08-7df66fa1ba51 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:08.483400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b839d-1e3e-4582-bb08-7df66fa1ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:08.505661 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-031b839d-1e3e-4582-bb08-7df66fa1ba51 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:00:08.506928 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-031b839d-1e3e-4582-bb08-7df66fa1ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:08.516664 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 588/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:00:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:00:08.790433 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a6ce-3029-40ac-a5e2-b3dc455a7484 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:08.792300 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e8d8a6ce-3029-40ac-a5e2-b3dc455a7484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:08.865598 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a6ce-3029-40ac-a5e2-b3dc455a7484 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:08.869424 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a44504-b2c0-40e7-a7a6-e9ab6fa28df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724caa2823654664b693e9a7edad2539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:08.870070 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44504-b2c0-40e7-a7a6-e9ab6fa28df3 service cinder] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:08.870351 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44504-b2c0-40e7-a7a6-e9ab6fa28df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:08.870625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44504-b2c0-40e7-a7a6-e9ab6fa28df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:08.880503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a44504-b2c0-40e7-a7a6-e9ab6fa28df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:08.881976 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a44504-b2c0-40e7-a7a6-e9ab6fa28df3 service cinder] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:08.891668 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 571/1159] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:00:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:00:11.205140 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d44e6-cc2d-4a82-af73-f749279577e8 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:11.205717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d44e6-cc2d-4a82-af73-f749279577e8 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:11.205717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d44e6-cc2d-4a82-af73-f749279577e8 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:11.207086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 589/1160] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:00:11.212639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a676dd5-98a7-4a51-a24e-6fe1f7614840 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:11.213120 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a676dd5-98a7-4a51-a24e-6fe1f7614840 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:11.213226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a676dd5-98a7-4a51-a24e-6fe1f7614840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:11.232275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-3a676dd5-98a7-4a51-a24e-6fe1f7614840 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:00:11.233550 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-3a676dd5-98a7-4a51-a24e-6fe1f7614840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:11.242921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 572/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:00:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:00:11.511690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d44e6-cc2d-4a82-af73-f749279577e8 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:11.513618 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-fd9d44e6-cc2d-4a82-af73-f749279577e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:11.528020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d44e6-cc2d-4a82-af73-f749279577e8 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:11.532059 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85abc16-92ff-4232-a7be-b9b7b1e2c05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724caa2823654664b693e9a7edad2539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:11.532732 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abc16-92ff-4232-a7be-b9b7b1e2c05c service cinder] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:11.533017 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abc16-92ff-4232-a7be-b9b7b1e2c05c service cinder] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:11.533296 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abc16-92ff-4232-a7be-b9b7b1e2c05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:11.543353 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abc16-92ff-4232-a7be-b9b7b1e2c05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:11.545003 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abc16-92ff-4232-a7be-b9b7b1e2c05c service cinder] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:11.554920 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 590/1162] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:00:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:00:21.227115 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=72 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:00:21.550423 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=27 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:31.942729 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386da0-fcf7-4b1b-98e3-620f5154ec28 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:31.943477 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386da0-fcf7-4b1b-98e3-620f5154ec28 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:31.943477 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386da0-fcf7-4b1b-98e3-620f5154ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:31.962865 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-c1386da0-fcf7-4b1b-98e3-620f5154ec28 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:31.969000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-c1386da0-fcf7-4b1b-98e3-620f5154ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:31.977116 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 573/1163] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:31.985685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:31.986257 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:31.986364 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25fc2-8815-4ac8-a44e-02d2cb95ace4 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:31.986476 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:31.986572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25fc2-8815-4ac8-a44e-02d2cb95ace4 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:31.986748 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25fc2-8815-4ac8-a44e-02d2cb95ace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.006106 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:32.007446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.010371 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-8bb25fc2-8815-4ac8-a44e-02d2cb95ace4 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:32.011538 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-8bb25fc2-8815-4ac8-a44e-02d2cb95ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.017351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 591/1164] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:32.021172 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 574/1165] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:01:32.022339 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.028496 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.028875 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.029310 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.032047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b41ed8-d200-47f5-9012-2da392a4564c None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.036532 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.037220 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.037498 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.037771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] PATH_INFO: `/v3/domains` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.038490 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:32.038792 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.039816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:01:32.039816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 21:01:32.039816 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 21:01:32.040745 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.047935 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:32.049192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.059101 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 592/1166] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:32.059282 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 575/1167] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:01:32.061423 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.063374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.071387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07c77-40c0-47b4-a3a1-9c249c93c50e admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.072327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4164-ff51-4832-b2af-8bc256de44ef None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.075994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.076866 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.076986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.077204 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.077509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.077790 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.077892 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.078064 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] PATH_INFO: `/v3/domains` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.078801 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:32.079107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.080592 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.080781 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.093253 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 576/1168] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:32.101482 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.111867 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b5941-033b-4bf8-a296-0d01af6f7338 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.117022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.117683 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.117818 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 593/1169] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:01:32.117969 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.118239 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.118954 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.119967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:01:32.119967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 21:01:32.119967 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 21:01:32.121284 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.124012 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.149312 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 577/1170] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:01:32.153578 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.190022 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4fe67-1c96-4b29-a02f-a350da301d7d admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.218334 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d205cf-39d1-4d2f-b78a-50f80375ae8d admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.223708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.224395 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.224703 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.224976 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.225670 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.227608 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.248019 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.248771 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.249052 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.252794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.252794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.252794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:01:32.252794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 21:01:32.252794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 21:01:32.252794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.259925 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 578/1171] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:01:32.264810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.275158 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 594/1172] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:01:32.275463 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5890dd-3413-45d6-a70c-297edae6f8ef admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.279318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.280400 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.281112 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.281393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.281669 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.282403 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.284058 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.289136 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9ff2-84f0-4033-8466-b247f1f5ac26 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.293979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.294651 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.294938 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.295149 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 579/1173] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:01:32.296914 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.297659 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.298999 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.299310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.308922 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce1a1-d4f6-4329-8e26-0f6b3be5a5cd admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.313141 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 595/1174] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:01:32.313638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.314127 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.314360 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.314638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.314980 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.315628 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.318588 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.324052 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425274c5-f49b-498d-8ae9-999b8175f950 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.328979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.329641 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.329916 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.330213 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.330635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 580/1175] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:01:32.331069 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.332692 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.334569 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.343660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 596/1176] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:01:32.344768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215270e3-aca6-4eb0-9e9d-9e0c485c0576 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.347798 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.349806 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.350698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.350975 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.351246 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] PATH_INFO: `/v3/projects/ef4ad59d7fd540fe865f6fb01fcb2794/users/9b8345e746fd4cc5945922b8d5f6bf89/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.357986 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25bbf-19d5-455c-b473-08f78a6dd9b9 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.364324 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4142c-9ea4-4495-8ba0-d62a0b96ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.365349 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4142c-9ea4-4495-8ba0-d62a0b96ea14 admin admin] REQUEST_METHOD: `PUT` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.365677 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4142c-9ea4-4495-8ba0-d62a0b96ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.365945 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4142c-9ea4-4495-8ba0-d62a0b96ea14 admin admin] PATH_INFO: `/v3/projects/8f65ff1d9c614f6a94afdbea55039740/users/4ee3f4b232f64c16967adcac6d6d014e/roles/87f72d0ef80748d3944fa5d7e9d022a0` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.370067 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4ad59d7fd540fe865f6fb01fcb2794, user_id=9b8345e746fd4cc5945922b8d5f6bf89, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.371365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:01:32.371365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 21:01:32.371365 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 21:01:32.373387 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82299327-ae39-442c-8e74-8612006ccabb admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.382829 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4142c-9ea4-4495-8ba0-d62a0b96ea14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f65ff1d9c614f6a94afdbea55039740, user_id=4ee3f4b232f64c16967adcac6d6d014e, role_id=87f72d0ef80748d3944fa5d7e9d022a0)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.386430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4142c-9ea4-4495-8ba0-d62a0b96ea14 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.389389 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 581/1177] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 21:01:32 2022] PUT /identity/v3/projects/ef4ad59d7fd540fe865f6fb01fcb2794/users/9b8345e746fd4cc5945922b8d5f6bf89/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:01:32.394579 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.394895 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.395158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.399370 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:32.407962 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 597/1178] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 21:01:32 2022] PUT /identity/v3/projects/8f65ff1d9c614f6a94afdbea55039740/users/4ee3f4b232f64c16967adcac6d6d014e/roles/87f72d0ef80748d3944fa5d7e9d022a0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:01:32.413465 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:32.414688 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.415130 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.415560 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.415979 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.435454 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] MFA Rules not processed for user `47b24d52328d4f3cb2e6a6ab9710e538`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:32.436722 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.459491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:32.476516 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 582/1179] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:01:32.487905 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.489491 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.501638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 598/1180] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:01:32.511948 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:32.513430 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.563448 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e694d0-5a78-4b0f-9bd7-297812772243 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.567269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b53e6b-686c-4cf4-8a51-19cc205b9aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.567958 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b53e6b-686c-4cf4-8a51-19cc205b9aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.568236 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b53e6b-686c-4cf4-8a51-19cc205b9aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.568505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b53e6b-686c-4cf4-8a51-19cc205b9aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.570492 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6c45c-4a91-492e-b964-7095d48c83c7 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:32.574091 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1913e1b-8bbb-4c88-92ab-ad19d9c017e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:32.574741 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913e1b-8bbb-4c88-92ab-ad19d9c017e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.575017 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913e1b-8bbb-4c88-92ab-ad19d9c017e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.575288 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913e1b-8bbb-4c88-92ab-ad19d9c017e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.579113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b53e6b-686c-4cf4-8a51-19cc205b9aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.580582 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b53e6b-686c-4cf4-8a51-19cc205b9aa0 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.584654 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1913e1b-8bbb-4c88-92ab-ad19d9c017e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:32.586096 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1913e1b-8bbb-4c88-92ab-ad19d9c017e3 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:32.590392 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 583/1181] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:01:32.595851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 599/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:01:38.080114 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.081874 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.083061 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.153590 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] MFA Rules not processed for user `9b8345e746fd4cc5945922b8d5f6bf89`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:38.154865 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:38.307411 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.308028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.308028 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.348855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 584/1183] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:38.353203 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.365621 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:38.366752 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec453ad-dd8f-472b-9125-f4ce498e5ca1 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.367348 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:38.371952 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.372820 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.373168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.373511 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] PATH_INFO: `/v3/projects` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.374280 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.376393 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.435529 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 585/1184] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:01:38.436633 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.489060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 600/1185] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:38.493515 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.514717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934c06-4d1b-4fcb-b403-9a5f3f549ea0 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.529227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:38.550197 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f519-8d90-4129-a2b2-93960ef3727c admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.556168 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.557014 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.557508 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.557855 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] PATH_INFO: `/v3/users` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.558630 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.560771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.561218 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:38.587771 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 586/1186] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:01:38.591660 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.599958 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.600797 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.601080 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.601355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.602060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.603487 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b173-4cae-4650-966b-9d7ead928722 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.604448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.608923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.609856 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.610312 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.610659 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.611464 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.613250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.626104 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 587/1187] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:01:38.630505 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.640325 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 601/1188] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:01:38.644399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.645033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173bc5c-4030-462a-94c2-94b82f545c3a admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.705397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.706225 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.706510 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.706787 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] PATH_INFO: `/v3/projects/137beb3572e34fd1baf11ac0254ab7e5/users/7deedf56c0ff44d1b963ecb790304fb4/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.723535 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=137beb3572e34fd1baf11ac0254ab7e5, user_id=7deedf56c0ff44d1b963ecb790304fb4, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.726286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.733458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053f52f-7007-4677-a791-0091f7690dc3 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.744693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 588/1189] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 21:01:38 2022] PUT /identity/v3/projects/137beb3572e34fd1baf11ac0254ab7e5/users/7deedf56c0ff44d1b963ecb790304fb4/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:01:38.749158 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.750283 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.751374 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.751806 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.752318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] PATH_INFO: `/v3/users` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.753442 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.756705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.791994 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 602/1190] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:01:38.795397 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.809056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5b57-a987-407d-9a70-509aaf1cd9ca admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.828073 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43e6e-4e92-435d-b904-b4639339bb6b admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.833770 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.834456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.834737 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.835005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] PATH_INFO: `/v3/roles` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.835885 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.837560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.853864 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 589/1191] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:01:38.855305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.866035 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bc7c0-575d-4ce5-8fc7-9ed7cd47783b admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.870921 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.871822 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.872283 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.872556 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] PATH_INFO: `/v3/projects/137beb3572e34fd1baf11ac0254ab7e5/users/7deedf56c0ff44d1b963ecb790304fb4/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.874636 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=137beb3572e34fd1baf11ac0254ab7e5, user_id=7deedf56c0ff44d1b963ecb790304fb4, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.876244 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.877044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.877378 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.877481 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.877726 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.878538 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:38.880224 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:38.889934 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 590/1192] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 21:01:38 2022] PUT /identity/v3/projects/137beb3572e34fd1baf11ac0254ab7e5/users/7deedf56c0ff44d1b963ecb790304fb4/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:01:38.894917 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 603/1193] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:01:38.899286 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:38.942955 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:38.983848 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf834b1-4398-4ae2-9b36-2f63730e9bbd admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:38.989676 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:38.990794 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.991082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.991424 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] PATH_INFO: `/v3/projects/3dbb56bb50dc41f8af7280a833445b4b/users/7c611690eed147d4ae794f394fbe485a/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:39.013563 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbb56bb50dc41f8af7280a833445b4b, user_id=7c611690eed147d4ae794f394fbe485a, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:39.017243 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:39.046560 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 591/1194] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 21:01:38 2022] PUT /identity/v3/projects/3dbb56bb50dc41f8af7280a833445b4b/users/7c611690eed147d4ae794f394fbe485a/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:01:39.049409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:39.064016 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983c272-0b40-4ad8-9aeb-0c06ca1c65dd admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:39.147307 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:39.173717 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568e585-134e-419e-a303-2c7b2c41b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:39.174465 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e585-134e-419e-a303-2c7b2c41b3bb admin admin] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:39.174746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e585-134e-419e-a303-2c7b2c41b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:39.175020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e585-134e-419e-a303-2c7b2c41b3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:39.175867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568e585-134e-419e-a303-2c7b2c41b3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:39.177569 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568e585-134e-419e-a303-2c7b2c41b3bb admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:39.191763 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 604/1195] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jul 23 21:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:01:39.195601 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:39.208012 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b684-504f-41f0-a583-0f05b785eb72 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:39.220420 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:39.221826 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:39.222107 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:39.222385 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] PATH_INFO: `/v3/projects/3dbb56bb50dc41f8af7280a833445b4b/users/7c611690eed147d4ae794f394fbe485a/roles/d384469b72f5485190c772f8974438e0` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:39.225162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbb56bb50dc41f8af7280a833445b4b, user_id=7c611690eed147d4ae794f394fbe485a, role_id=d384469b72f5485190c772f8974438e0)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:39.228162 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:39.257088 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 592/1196] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jul 23 21:01:39 2022] PUT /identity/v3/projects/3dbb56bb50dc41f8af7280a833445b4b/users/7c611690eed147d4ae794f394fbe485a/roles/d384469b72f5485190c772f8974438e0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:01:47.134320 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df538-1e48-4a4d-a320-9f0f15db6816 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:47.135363 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df538-1e48-4a4d-a320-9f0f15db6816 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:47.135363 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df538-1e48-4a4d-a320-9f0f15db6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:47.201978 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-c12df538-1e48-4a4d-a320-9f0f15db6816 None None] MFA Rules not processed for user `7deedf56c0ff44d1b963ecb790304fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:47.203446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-c12df538-1e48-4a4d-a320-9f0f15db6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:47.343637 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 605/1197] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:47 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:47.361886 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:47.367296 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:47.373174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:47.373310 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:47.373557 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:47.408279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] MFA Rules not processed for user `7c611690eed147d4ae794f394fbe485a`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:47.409570 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:47.478349 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e3b9-26a2-446e-9b78-edcf0ab30c68 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:47.484750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf68d-9b8e-495b-9c88-6a0ca2dd54c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a9c4b74df4fc1b4a4351652ed499a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:47.485462 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf68d-9b8e-495b-9c88-6a0ca2dd54c6 service glance] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:47.485740 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf68d-9b8e-495b-9c88-6a0ca2dd54c6 service glance] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:47.486016 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf68d-9b8e-495b-9c88-6a0ca2dd54c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:47.514233 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 606/1198] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:47 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:47.539458 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:47.542306 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:47.560350 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6bdd-ec50-4bf9-95f5-848843e94a16 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:47.566785 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577ed5-7e7d-4150-b498-31488695674e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a9c4b74df4fc1b4a4351652ed499a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:47.567479 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577ed5-7e7d-4150-b498-31488695674e service glance] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:47.567811 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577ed5-7e7d-4150-b498-31488695674e service glance] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:47.568092 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577ed5-7e7d-4150-b498-31488695674e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:47.571595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf68d-9b8e-495b-9c88-6a0ca2dd54c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:47.574170 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf68d-9b8e-495b-9c88-6a0ca2dd54c6 service glance] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:47.587804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 593/1199] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:47 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:01:47.642925 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=100 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:47.664572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577ed5-7e7d-4150-b498-31488695674e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:47.666838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577ed5-7e7d-4150-b498-31488695674e service glance] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:47.682021 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 607/1200] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:47 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:01:57.394227 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8f2a-b1f3-441c-8c5e-3686427b49f2 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:57.394883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8f2a-b1f3-441c-8c5e-3686427b49f2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:57.394883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8f2a-b1f3-441c-8c5e-3686427b49f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:57.417639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-e0ca8f2a-b1f3-441c-8c5e-3686427b49f2 None None] MFA Rules not processed for user `9b8345e746fd4cc5945922b8d5f6bf89`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:57.418912 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-e0ca8f2a-b1f3-441c-8c5e-3686427b49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:57.428651 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 594/1201] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:01:57 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:57.676279 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=5 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:57.740140 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4afa-9f52-43ee-9611-b078c6573398 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:57.740425 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4afa-9f52-43ee-9611-b078c6573398 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:57.740726 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4afa-9f52-43ee-9611-b078c6573398 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:57.742147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 608/1202] 10.222.0.18 () {54 vars in 962 bytes} [Sat Jul 23 21:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:57.747996 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743c1f-1ece-432a-ba8b-cfffd0d7352d None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:57.748519 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743c1f-1ece-432a-ba8b-cfffd0d7352d None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:57.748857 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743c1f-1ece-432a-ba8b-cfffd0d7352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:57.786414 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-89743c1f-1ece-432a-ba8b-cfffd0d7352d None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:57.788148 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-89743c1f-1ece-432a-ba8b-cfffd0d7352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:57.833374 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:57.881657 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 595/1203] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jul 23 21:01:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:01:57.887602 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682d8c1-3c33-4188-bbf7-94be117ffd44 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:57.888260 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682d8c1-3c33-4188-bbf7-94be117ffd44 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:57.888537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682d8c1-3c33-4188-bbf7-94be117ffd44 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:57.890196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 609/1204] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jul 23 21:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:57.895337 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4b88-ad5b-4403-a657-274becc2bff1 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:57.895847 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4b88-ad5b-4403-a657-274becc2bff1 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:57.896192 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4b88-ad5b-4403-a657-274becc2bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:57.923221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-be1e4b88-ad5b-4403-a657-274becc2bff1 None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:57.924397 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-be1e4b88-ad5b-4403-a657-274becc2bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:57.938091 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 596/1205] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jul 23 21:01:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:57.950483 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682d8c1-3c33-4188-bbf7-94be117ffd44 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:57.971368 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682d8c1-3c33-4188-bbf7-94be117ffd44 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:57.981887 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f985d0-c000-4554-afa4-e518915d6b42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a9c4b74df4fc1b4a4351652ed499a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:57.982642 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f985d0-c000-4554-afa4-e518915d6b42 service glance] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:57.983018 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f985d0-c000-4554-afa4-e518915d6b42 service glance] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:57.983387 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f985d0-c000-4554-afa4-e518915d6b42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:57.996323 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f985d0-c000-4554-afa4-e518915d6b42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:57.997984 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f985d0-c000-4554-afa4-e518915d6b42 service glance] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:58.009820 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 610/1206] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:01:58.399629 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166600b-c5f7-4340-bdd5-55d5311139ba None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:58.400239 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166600b-c5f7-4340-bdd5-55d5311139ba None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:58.400239 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166600b-c5f7-4340-bdd5-55d5311139ba None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:58.401635 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 597/1207] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jul 23 21:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:58.407398 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ae78-c36a-4d0e-bd45-c2679e3c0fea None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:58.407680 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ae78-c36a-4d0e-bd45-c2679e3c0fea None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:58.407973 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ae78-c36a-4d0e-bd45-c2679e3c0fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:58.434075 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-ec88ae78-c36a-4d0e-bd45-c2679e3c0fea None None] MFA Rules not processed for user `e27cdef8bd764dbf8243a4e0f4d8102a`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:58.435532 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-ec88ae78-c36a-4d0e-bd45-c2679e3c0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:58.504275 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 611/1208] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jul 23 21:01:58 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:58.518571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166600b-c5f7-4340-bdd5-55d5311139ba None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:58.537295 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166600b-c5f7-4340-bdd5-55d5311139ba None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:58.542113 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38404bb-2326-4c82-8b91-7c2dcc0b74df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:58.542924 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38404bb-2326-4c82-8b91-7c2dcc0b74df service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:58.543266 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38404bb-2326-4c82-8b91-7c2dcc0b74df service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:58.543561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38404bb-2326-4c82-8b91-7c2dcc0b74df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:58.553718 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38404bb-2326-4c82-8b91-7c2dcc0b74df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:58.555653 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38404bb-2326-4c82-8b91-7c2dcc0b74df service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:58.568810 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 598/1209] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:58 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:01:58.994867 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff0530-5bea-467f-b52b-2564fa0f3a41 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:58.995462 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff0530-5bea-467f-b52b-2564fa0f3a41 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:58.995462 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff0530-5bea-467f-b52b-2564fa0f3a41 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:58.997298 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 612/1210] 10.222.0.18 () {54 vars in 962 bytes} [Sat Jul 23 21:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:59.004139 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf26c-8eb5-43ef-b465-0fdbb4318d67 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.004585 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf26c-8eb5-43ef-b465-0fdbb4318d67 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.004879 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf26c-8eb5-43ef-b465-0fdbb4318d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.016415 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecac92-066b-4c83-a9d0-b45655dfa879 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.016667 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecac92-066b-4c83-a9d0-b45655dfa879 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.017044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecac92-066b-4c83-a9d0-b45655dfa879 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.018850 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 613/1211] 10.222.0.18 () {54 vars in 961 bytes} [Sat Jul 23 21:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:59.024212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.024212 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.024563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.036072 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-0debf26c-8eb5-43ef-b465-0fdbb4318d67 None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:59.037324 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0debf26c-8eb5-43ef-b465-0fdbb4318d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:59.047693 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 599/1212] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jul 23 21:01:59 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:59.052535 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:59.055429 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2b1f-6be8-44b6-bcc7-ef41f0e886f7 None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.055712 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2b1f-6be8-44b6-bcc7-ef41f0e886f7 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.055984 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2b1f-6be8-44b6-bcc7-ef41f0e886f7 None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.056706 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:59.057963 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 600/1213] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jul 23 21:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:01:59.066498 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.066782 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.067059 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.089868 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:59.091572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:59.104033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 601/1214] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jul 23 21:01:59 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:01:59.116720 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:59.126928 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555012b-8740-4adb-9ec4-41fba80a8061 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:59.130765 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e22fd-aeef-4d84-b903-1c4ee47053d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:59.131418 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e22fd-aeef-4d84-b903-1c4ee47053d9 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.131719 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e22fd-aeef-4d84-b903-1c4ee47053d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.131990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e22fd-aeef-4d84-b903-1c4ee47053d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.132374 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 614/1215] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jul 23 21:01:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:01:59.140318 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:59.143219 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e22fd-aeef-4d84-b903-1c4ee47053d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:59.144889 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e22fd-aeef-4d84-b903-1c4ee47053d9 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:59.150899 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05ddb0-0bb7-49c8-bc29-425c2954c9ea None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:59.156532 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 602/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:59 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:01:59.161058 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:59.161752 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:59.162030 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:59.162304 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:59.164300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:59.176650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:59.178724 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:59.190344 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 615/1217] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:01:59 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:02:09.151939 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=37 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:09.184485 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=64 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:09.399456 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee9d6-ea2d-402d-ab19-45c01f4cde30 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:09.399768 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee9d6-ea2d-402d-ab19-45c01f4cde30 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:09.400046 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee9d6-ea2d-402d-ab19-45c01f4cde30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:09.418376 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-d42ee9d6-ea2d-402d-ab19-45c01f4cde30 None None] MFA Rules not processed for user `e27cdef8bd764dbf8243a4e0f4d8102a`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:09.419533 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d42ee9d6-ea2d-402d-ab19-45c01f4cde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:09.426370 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 603/1218] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Jul 23 21:02:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:09.440115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:09.450239 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4664b2-ac60-4653-be15-319ec05ef921 service placement] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:09.455151 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e1ede-fd5d-4a50-94e9-b0d0b8a996ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:09.455838 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e1ede-fd5d-4a50-94e9-b0d0b8a996ad service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:09.456163 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e1ede-fd5d-4a50-94e9-b0d0b8a996ad service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:09.456446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e1ede-fd5d-4a50-94e9-b0d0b8a996ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:09.466122 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e1ede-fd5d-4a50-94e9-b0d0b8a996ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:09.467700 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e1ede-fd5d-4a50-94e9-b0d0b8a996ad service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:09.476975 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 616/1219] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:02:10.275132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fd41f-12f0-430e-bd88-f69adf8f65af None None] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:10.275726 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fd41f-12f0-430e-bd88-f69adf8f65af None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:10.275890 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fd41f-12f0-430e-bd88-f69adf8f65af None None] PATH_INFO: `/` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:10.277454 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 604/1220] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 21:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:02:10.286013 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e24d8-a710-4240-93a1-415c9ebea7a5 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:10.286605 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e24d8-a710-4240-93a1-415c9ebea7a5 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:10.286605 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e24d8-a710-4240-93a1-415c9ebea7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:10.312415 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-267e24d8-a710-4240-93a1-415c9ebea7a5 None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:10.313675 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-267e24d8-a710-4240-93a1-415c9ebea7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:10.323871 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 617/1221] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 21:02:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:10.352238 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fd41f-12f0-430e-bd88-f69adf8f65af None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:10.372275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fd41f-12f0-430e-bd88-f69adf8f65af None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:10.384552 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce44305-ea66-4aaa-ab98-3569230395b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:10.385753 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce44305-ea66-4aaa-ab98-3569230395b6 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:10.386090 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce44305-ea66-4aaa-ab98-3569230395b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:10.386375 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce44305-ea66-4aaa-ab98-3569230395b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:10.397894 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce44305-ea66-4aaa-ab98-3569230395b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:10.399571 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce44305-ea66-4aaa-ab98-3569230395b6 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:10.411595 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 605/1222] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:02:17.306638 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c744a-713b-45e5-a6ee-16c8bd2eae9a None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:17.308940 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c744a-713b-45e5-a6ee-16c8bd2eae9a None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:17.309443 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c744a-713b-45e5-a6ee-16c8bd2eae9a None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:17.313873 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 618/1223] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 21:02:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:02:17.323767 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:17.324568 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:17.325055 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:17.357203 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:17.359687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:17.380033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 606/1224] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 21:02:17 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:17.394584 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c744a-713b-45e5-a6ee-16c8bd2eae9a None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:17.409049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c744a-713b-45e5-a6ee-16c8bd2eae9a None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:17.413935 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72446-9f28-4a1c-9bdc-d2544095236a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:17.414611 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72446-9f28-4a1c-9bdc-d2544095236a service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:17.414941 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72446-9f28-4a1c-9bdc-d2544095236a service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:17.415211 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72446-9f28-4a1c-9bdc-d2544095236a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:17.424226 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d72446-9f28-4a1c-9bdc-d2544095236a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:17.425934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d72446-9f28-4a1c-9bdc-d2544095236a service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:17.437300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 619/1225] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:17 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:02:27.348585 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=12 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:27.432905 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=15 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:29.464509 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:29.474427 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ffe9-0908-4675-9c0c-2fb25da7a1ee None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:29.478251 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ab6b3-3f45-49e4-a197-8bef0407bbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:29.478914 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ab6b3-3f45-49e4-a197-8bef0407bbfc service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:29.479190 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ab6b3-3f45-49e4-a197-8bef0407bbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:29.479467 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ab6b3-3f45-49e4-a197-8bef0407bbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:29.489269 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ab6b3-3f45-49e4-a197-8bef0407bbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:29.491024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ab6b3-3f45-49e4-a197-8bef0407bbfc service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:29.502000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 607/1226] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:29 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:02:33.813736 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511afe-5c94-4212-9e4f-ba11cfc7c064 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:33.814755 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511afe-5c94-4212-9e4f-ba11cfc7c064 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:33.815199 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511afe-5c94-4212-9e4f-ba11cfc7c064 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:33.816915 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 620/1227] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 21:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:02:33.848215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11beb2-9c8a-43b3-8f1b-7da2034b40cc None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:33.849211 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11beb2-9c8a-43b3-8f1b-7da2034b40cc None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:33.849647 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11beb2-9c8a-43b3-8f1b-7da2034b40cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:33.870638 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-7c11beb2-9c8a-43b3-8f1b-7da2034b40cc None None] MFA Rules not processed for user `ee135c0b41e1474686678d60dc5018ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:33.871893 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-7c11beb2-9c8a-43b3-8f1b-7da2034b40cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:33.883218 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 608/1228] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 21:02:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:33.940787 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511afe-5c94-4212-9e4f-ba11cfc7c064 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:33.967487 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511afe-5c94-4212-9e4f-ba11cfc7c064 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:33.979600 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9e3d-4668-4125-a66d-d51c686360d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:33.980843 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9e3d-4668-4125-a66d-d51c686360d7 service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:33.982379 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9e3d-4668-4125-a66d-d51c686360d7 service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:33.982746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9e3d-4668-4125-a66d-d51c686360d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:34.011835 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf9e3d-4668-4125-a66d-d51c686360d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:34.013864 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf9e3d-4668-4125-a66d-d51c686360d7 service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:34.036044 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 621/1229] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:02:43.864309 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=9 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:44.025840 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=6 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:51.334512 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:51.335179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:51.335449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:51.365108 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:51.367141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:51.379230 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 609/1230] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:02:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:51.721427 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96804648-8ce9-4185-b0a9-8eb2916fe3a3 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:51.722273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96804648-8ce9-4185-b0a9-8eb2916fe3a3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:51.722273 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96804648-8ce9-4185-b0a9-8eb2916fe3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:51.744172 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-96804648-8ce9-4185-b0a9-8eb2916fe3a3 None None] MFA Rules not processed for user `e27cdef8bd764dbf8243a4e0f4d8102a`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:51.745475 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-96804648-8ce9-4185-b0a9-8eb2916fe3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:51.753115 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 622/1231] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jul 23 21:02:51 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:51.765287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:51.775998 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e28e9-bb23-4d83-8cba-1fc87da725e0 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:51.780496 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2bcd2-f163-4021-a4d8-ba5d96fd4f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:51.781179 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2bcd2-f163-4021-a4d8-ba5d96fd4f30 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:51.781461 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2bcd2-f163-4021-a4d8-ba5d96fd4f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:51.781792 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2bcd2-f163-4021-a4d8-ba5d96fd4f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:51.791706 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2bcd2-f163-4021-a4d8-ba5d96fd4f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:51.794186 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2bcd2-f163-4021-a4d8-ba5d96fd4f30 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:51.805313 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 610/1232] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:51 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:01.738142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:01.800102 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=9 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:18.223863 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f958d-8e6e-49cd-bfaf-e90e6879ad11 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:18.224469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f958d-8e6e-49cd-bfaf-e90e6879ad11 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:18.224469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f958d-8e6e-49cd-bfaf-e90e6879ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:18.245390 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-921f958d-8e6e-49cd-bfaf-e90e6879ad11 None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:18.246633 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-921f958d-8e6e-49cd-bfaf-e90e6879ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:18.255249 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 623/1233] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:03:18 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:28.239034 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:32.883953 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:32.884503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:32.884503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:32.904474 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:32.905749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:32.914215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 611/1234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:03:32 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:42.898132 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:30.968423 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:30.969085 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:30.969437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:30.994243 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:30.995578 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:31.005147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 624/1235] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:04:30 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:40.988437 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=3 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:45.572481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:45.600804 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9eddf-4ef5-4055-a8f0-6f0bbf5d162e None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:45.604825 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490f75-18ad-4bc5-9e5d-725778199cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:45.605458 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490f75-18ad-4bc5-9e5d-725778199cfd service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:45.605809 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490f75-18ad-4bc5-9e5d-725778199cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:45.605990 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490f75-18ad-4bc5-9e5d-725778199cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:45.616072 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61490f75-18ad-4bc5-9e5d-725778199cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:45.617739 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61490f75-18ad-4bc5-9e5d-725778199cfd service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:45.628026 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 612/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:45 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:55.623938 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=10 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:43.452587 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:43.478067 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612607d-45d8-49fb-94dd-7f87580d4ac1 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:43.484145 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:43.484845 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:43.485129 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:43.485399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:43.495747 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:43.496572 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:43.507231 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 625/1237] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:53.502665 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=10 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:21.849096 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:21.849656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:21.849656 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:21.868142 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] MFA Rules not processed for user `9b8345e746fd4cc5945922b8d5f6bf89`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:21.869530 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:21.877631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 613/1238] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:06:21 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:31.862522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=3 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:46.738705 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:46.753449 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8da765-22a1-4a22-a261-fd171cb3ebc3 service placement] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:46.759147 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:46.761047 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:46.761399 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:46.761823 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:46.776666 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:46.778685 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:46.790948 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 626/1239] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:46 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:06:56.785085 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=6 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:01.417084 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:01.438609 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20097c04-acba-45e1-9448-9a090a4288e2 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:01.443572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:01.444244 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:01.444525 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:01.444828 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:01.452957 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:01.454507 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:01.464024 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 614/1240] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:01 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:07:01.647334 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:01.656781 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a16b3-54ec-48bc-b510-d691f5729e01 service neutron] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:01.661650 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eaf76-f9eb-478c-8495-c2dfd89063b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:01.662303 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf76-f9eb-478c-8495-c2dfd89063b7 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:01.662581 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf76-f9eb-478c-8495-c2dfd89063b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:01.662851 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf76-f9eb-478c-8495-c2dfd89063b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:01.674241 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf76-f9eb-478c-8495-c2dfd89063b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:01.675713 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf76-f9eb-478c-8495-c2dfd89063b7 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:01.686632 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 627/1241] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:07:02.874275 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:02.883701 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b0bfe-66eb-4832-b6ea-4578dd1a2e07 service nova] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:02.887561 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:02.888327 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:02.888639 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:02.888923 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:02.899497 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:02.901000 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:02.912155 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 615/1242] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:07:05.187113 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] REQUEST_METHOD: `POST` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:05.187660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:05.187660 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:05.210912 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.auth.core [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:07:05.213219 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:05.223258 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 628/1243] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:07:05 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:07:06.185978 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:06.198109 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602219f1-f13c-4dc4-8a72-6955544aed38 service neutron] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:06.203135 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:06.203787 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:06.204763 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:06.205038 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:06.214725 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:06.216449 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:06.228643 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 616/1244] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:07:08.901441 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:08.912096 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f372190-4aae-46f2-b82e-228aaa0748e3 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:08.915968 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:08.916657 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:08.916934 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:08.917203 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:08.925448 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:08.926884 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:08.938834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 629/1245] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:08 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:07:16.224215 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=22 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:18.933305 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=15 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:01.724959 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:01.740221 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851272-0993-4b4e-877a-6228f7881e30 service placement] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:01.757542 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:01.758481 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:01.759373 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:01.760046 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:01.780145 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:01.782141 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:01.798033 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 617/1246] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:08:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:08:08.187494 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:08.203865 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05dbee-a49e-4922-a736-0dd3028b8c3d service neutron] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:08.211317 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aba5e6-cf9c-4a07-a5a5-cd6d04072aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:08.211989 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aba5e6-cf9c-4a07-a5a5-cd6d04072aae service nova] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:08.212266 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aba5e6-cf9c-4a07-a5a5-cd6d04072aae service nova] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:08.212537 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aba5e6-cf9c-4a07-a5a5-cd6d04072aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:08.223260 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aba5e6-cf9c-4a07-a5a5-cd6d04072aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:08.225060 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aba5e6-cf9c-4a07-a5a5-cd6d04072aae service nova] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:08.238817 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 630/1247] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:08:08 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:08:09.387631 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:09.397958 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f25127-cf3d-4e81-9cc5-1658cc767c80 service nova] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:09.401891 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5c837-9607-440c-9300-ce01fd340ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:09.402539 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5c837-9607-440c-9300-ce01fd340ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:09.402814 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5c837-9607-440c-9300-ce01fd340ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:09.403090 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5c837-9607-440c-9300-ce01fd340ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:09.471473 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5c837-9607-440c-9300-ce01fd340ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:09.473288 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5c837-9607-440c-9300-ce01fd340ff1 service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:09.495351 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 618/1248] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:08:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:08:13.201779 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dd3b8-1c7d-4efe-a744-e84c9a39bc80 None None] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:13.202409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dd3b8-1c7d-4efe-a744-e84c9a39bc80 None None] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:13.202409 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dd3b8-1c7d-4efe-a744-e84c9a39bc80 None None] PATH_INFO: `/` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:13.203794 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 631/1249] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jul 23 21:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:08:13.245174 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:13.245860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:13.245860 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:13.322917 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] MFA Rules not processed for user `74b7c0b2078f4349bdf2fbb717fc7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:08:13.324239 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:08:13.334043 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 619/1250] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jul 23 21:08:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:08:13.349488 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dd3b8-1c7d-4efe-a744-e84c9a39bc80 None None] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:13.364788 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dd3b8-1c7d-4efe-a744-e84c9a39bc80 None None] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:13.371086 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:13.371825 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:13.372188 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:13.372544 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:13.382023 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:13.383555 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:13.394828 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 632/1251] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:08:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:08:16.637423 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:16.649248 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ec18d-5eaf-435d-bec3-4439d8db5b5e None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:16.653833 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:16.654724 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:16.655005 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:16.655330 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] PATH_INFO: `/v3/users/9b8345e746fd4cc5945922b8d5f6bf89` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:16.656523 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8345e746fd4cc5945922b8d5f6bf89)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:16.657749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: WARNING py.warnings [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:08:16.657749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: warnings.warn(msg) Jul 23 21:08:16.657749 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: Jul 23 21:08:16.658962 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:16.724503 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8345e746fd4cc5945922b8d5f6bf89'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:16.742422 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8345e746fd4cc5945922b8d5f6bf89'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:16.743105 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8345e746fd4cc5945922b8d5f6bf89'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:16.743698 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8345e746fd4cc5945922b8d5f6bf89'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:16.751697 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8345e746fd4cc5945922b8d5f6bf89'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:16.767613 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 620/1252] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jul 23 21:08:16 2022] DELETE /identity/v3/users/9b8345e746fd4cc5945922b8d5f6bf89 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:08:16.966758 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:16.978142 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1f15f-9ebc-4ced-bdb5-2f6e3fa19020 service placement] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:17.037804 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:17.038673 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:17.038951 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:17.039221 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] PATH_INFO: `/v3/projects/ef4ad59d7fd540fe865f6fb01fcb2794` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:17.040401 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4ad59d7fd540fe865f6fb01fcb2794)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:17.041471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: WARNING py.warnings [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:08:17.041471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: warnings.warn(msg) Jul 23 21:08:17.041471 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: Jul 23 21:08:17.042658 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:17.097499 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4ad59d7fd540fe865f6fb01fcb2794', 'request_id': 'req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.110712 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4ad59d7fd540fe865f6fb01fcb2794', 'request_id': 'req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.117342 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4ad59d7fd540fe865f6fb01fcb2794', 'request_id': 'req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.130883 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] The token cache is being invalidate because project ef4ad59d7fd540fe865f6fb01fcb2794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:08:17.131196 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.131813 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.133469 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 633/1253] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jul 23 21:08:16 2022] DELETE /identity/v3/projects/ef4ad59d7fd540fe865f6fb01fcb2794 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:08:17.137750 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:17.139625 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:08:17.151320 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:17.155138 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed661d-0f84-42e0-bcb9-54fdc89e9957 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:17.213025 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:17.213914 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:17.214207 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:17.214480 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] PATH_INFO: `/v3/users/7deedf56c0ff44d1b963ecb790304fb4` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:17.215849 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7deedf56c0ff44d1b963ecb790304fb4)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:17.217838 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:17.268153 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7deedf56c0ff44d1b963ecb790304fb4'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.279884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7deedf56c0ff44d1b963ecb790304fb4'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.280583 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7deedf56c0ff44d1b963ecb790304fb4'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.281226 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7deedf56c0ff44d1b963ecb790304fb4'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.290493 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-732ca3e0-2be1-4656-861f-80ebff86e3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7deedf56c0ff44d1b963ecb790304fb4'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.303231 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 621/1254] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jul 23 21:08:17 2022] DELETE /identity/v3/users/7deedf56c0ff44d1b963ecb790304fb4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:08:17.485245 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:08:17.487014 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:08:17.500519 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a875fbc-ee9e-478f-8c0a-6b7ffe036ae6 admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:08:17.567190 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:08:17.568056 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:08:17.568355 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:08:17.568674 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] PATH_INFO: `/v3/projects/137beb3572e34fd1baf11ac0254ab7e5` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:08:17.569909 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=137beb3572e34fd1baf11ac0254ab7e5)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:08:17.571837 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:08:17.578613 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:17.629676 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137beb3572e34fd1baf11ac0254ab7e5', 'request_id': 'req-30f8bd1a-b8c0-4804-9de7-23235707d93a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.635746 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137beb3572e34fd1baf11ac0254ab7e5', 'request_id': 'req-30f8bd1a-b8c0-4804-9de7-23235707d93a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.641715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137beb3572e34fd1baf11ac0254ab7e5', 'request_id': 'req-30f8bd1a-b8c0-4804-9de7-23235707d93a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.655517 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] The token cache is being invalidate because project 137beb3572e34fd1baf11ac0254ab7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:08:17.655799 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.656480 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:08:17.658181 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 634/1255] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jul 23 21:08:17 2022] DELETE /identity/v3/projects/137beb3572e34fd1baf11ac0254ab7e5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:08:27.299972 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:27.652305 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:09:09.907147 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] REQUEST_METHOD: `POST` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:09:09.907708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:09:09.907708 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:09:09.928317 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.auth.core [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] MFA Rules not processed for user `4ee3f4b232f64c16967adcac6d6d014e`. Rule list: `[]` (Enabled: `True`). {{(pid=93849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:09:09.929576 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:09:10.001250 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 622/1256] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jul 23 21:09:09 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:09:10.353652 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:09:10.355247 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:09:10.417889 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8bd1a-b8c0-4804-9de7-23235707d93a admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:09:10.422330 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:09:10.423024 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:09:10.423290 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:09:10.423563 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:09:10.425715 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:09:10.437194 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:09:10.439159 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:09:10.448431 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 635/1257] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:09:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:09:19.490178 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:09:19.491966 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:09:19.567285 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040687cf-aa7e-4ce8-ba63-6531fc9b56d3 None None] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:09:19.574901 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee135c0b41e1474686678d60dc5018ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:09:19.575811 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:09:19.576188 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:09:19.576559 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:09:19.579522 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:09:19.593321 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:09:19.594934 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:09:19.605037 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 623/1258] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:09:19 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:09:20.444834 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=26 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:09:29.600715 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=57 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:10:45.468186 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:10:45.470020 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:10:45.598737 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15923-9e06-42ec-aff9-5620c2551c72 service neutron] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:10:45.605719 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:10:45.606371 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:10:45.606648 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:10:45.606902 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:10:45.609365 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:10:45.621497 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:10:45.623118 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:10:45.633993 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 636/1259] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:10:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:10:55.629179 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=54 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:58.017652 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:58.037787 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012e6cf-c2a4-43f7-a79a-3fbe178c62a4 service nova] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:58.042980 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27cdef8bd764dbf8243a4e0f4d8102a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:58.043919 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] REQUEST_METHOD: `GET` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:58.044290 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:58.044685 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:58.047437 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:58.147362 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:58.148884 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:58.158887 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 624/1260] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:12:04.471775 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:12:04.473856 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:12:04.487791 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fd3f-f2a8-4c67-ac28-14c7cb32b667 service placement] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:12:04.493051 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:12:04.493956 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:12:04.494234 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:12:04.494509 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] PATH_INFO: `/v3/users/4ee3f4b232f64c16967adcac6d6d014e` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:12:04.509049 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee3f4b232f64c16967adcac6d6d014e)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:12:04.510939 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:12:04.570937 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee3f4b232f64c16967adcac6d6d014e'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.584966 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee3f4b232f64c16967adcac6d6d014e'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.585690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee3f4b232f64c16967adcac6d6d014e'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.586300 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee3f4b232f64c16967adcac6d6d014e'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.594412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee3f4b232f64c16967adcac6d6d014e'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.606889 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 637/1261] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jul 23 21:12:04 2022] DELETE /identity/v3/users/4ee3f4b232f64c16967adcac6d6d014e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:12:04.791661 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:12:04.803299 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865c911-efe1-422c-937c-6e852a381f2a service neutron] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:12:04.868685 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:12:04.869601 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:12:04.869883 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:12:04.870159 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] PATH_INFO: `/v3/projects/8f65ff1d9c614f6a94afdbea55039740` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:12:04.881319 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f65ff1d9c614f6a94afdbea55039740)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:12:04.883278 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:12:04.943576 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f65ff1d9c614f6a94afdbea55039740', 'request_id': 'req-0b27c468-64a8-46b5-80c1-bec2741e8539'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.950336 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f65ff1d9c614f6a94afdbea55039740', 'request_id': 'req-0b27c468-64a8-46b5-80c1-bec2741e8539'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.953015 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:04.960205 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f65ff1d9c614f6a94afdbea55039740', 'request_id': 'req-0b27c468-64a8-46b5-80c1-bec2741e8539'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.972287 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] The token cache is being invalidate because project 8f65ff1d9c614f6a94afdbea55039740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:12:04.972572 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.973305 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:04.975022 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 625/1262] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jul 23 21:12:04 2022] DELETE /identity/v3/projects/8f65ff1d9c614f6a94afdbea55039740 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:12:04.979250 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:12:04.980702 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:12:04.994087 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2fee6-b0ea-4df9-8aac-6f19ca576efb admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:12:05.052351 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:12:05.053182 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:12:05.053446 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:12:05.053720 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] PATH_INFO: `/v3/users/7c611690eed147d4ae794f394fbe485a` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:12:05.070673 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c611690eed147d4ae794f394fbe485a)` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:12:05.072690 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:12:05.123460 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c611690eed147d4ae794f394fbe485a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.127982 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:05.137990 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c611690eed147d4ae794f394fbe485a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.138693 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c611690eed147d4ae794f394fbe485a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.139400 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c611690eed147d4ae794f394fbe485a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.148678 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.notifications [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c611690eed147d4ae794f394fbe485a'} {{(pid=93848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.165174 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 638/1263] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jul 23 21:12:04 2022] DELETE /identity/v3/users/7c611690eed147d4ae794f394fbe485a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:12:05.352881 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Authenticating user token {{(pid=93849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:12:05.354614 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.fernet_utils [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:12:05.370398 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c468-64a8-46b5-80c1-bec2741e8539 admin admin] Validating token access rules against request {{(pid=93849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:12:05.436445 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b24d52328d4f3cb2e6a6ab9710e538', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e6ecd9bce64bb4817795f5da7ca976', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:12:05.437399 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:12:05.437687 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:12:05.437993 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] PATH_INFO: `/v3/projects/3dbb56bb50dc41f8af7280a833445b4b` {{(pid=93849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:12:05.453602 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbb56bb50dc41f8af7280a833445b4b)` {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:12:05.456243 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] RBAC: Authorization granted {{(pid=93849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:12:05.509082 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbb56bb50dc41f8af7280a833445b4b', 'request_id': 'req-aa25fe45-9273-4bcd-b553-02aa688127dd'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.516444 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbb56bb50dc41f8af7280a833445b4b', 'request_id': 'req-aa25fe45-9273-4bcd-b553-02aa688127dd'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.526180 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbb56bb50dc41f8af7280a833445b4b', 'request_id': 'req-aa25fe45-9273-4bcd-b553-02aa688127dd'} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.537935 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] The token cache is being invalidate because project 3dbb56bb50dc41f8af7280a833445b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:12:05.537935 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.538440 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG keystone.notifications [None req-aa25fe45-9273-4bcd-b553-02aa688127dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:12:05.540069 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: [pid: 93849|app: 0|req: 626/1264] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jul 23 21:12:05 2022] DELETE /identity/v3/projects/3dbb56bb50dc41f8af7280a833445b4b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:12:15.161611 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:15.534521 dv-osbrick-master-4-ceph devstack@keystone.service[93849]: DEBUG dbcounter [-] [93849] Writing DB stats keystone:DELETE=10,keystone:SELECT=59,keystone:INSERT=1 {{(pid=93849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:53.541630 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Authenticating user token {{(pid=93848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:53.543263 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:53.638711 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd94d9-735c-4069-b8d3-fac04ad9ebea admin admin] Validating token access rules against request {{(pid=93848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:53.711730 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b7c0b2078f4349bdf2fbb717fc7d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1b8297aa7348728884cac62ab1232a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:53.712412 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] REQUEST_METHOD: `GET` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:53.712731 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] SCRIPT_NAME: `/identity` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:53.713003 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:53.715048 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.fernet_utils [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:53.728845 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:53.730659 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d8669-07a8-4b5c-83e0-a4cb1f42e8f5 service placement] RBAC: Authorization granted {{(pid=93848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:53.742974 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: [pid: 93848|app: 0|req: 639/1265] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:53 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:03.737987 dv-osbrick-master-4-ceph devstack@keystone.service[93848]: DEBUG dbcounter [-] [93848] Writing DB stats keystone:SELECT=62 {{(pid=93848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}